-- Logs begin at Wed 2022-07-06 14:42:33 UTC, end at Wed 2022-07-06 15:42:38 UTC. -- Jul 06 15:12:36.328411 dv-cinder-848848-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 06 15:12:36.337421 dv-cinder-848848-4-smb devstack@keystone.service[80185]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 15:12:36 2022] *** Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: nodename: dv-cinder-848848-4-smb Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: machine: x86_64 Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: clock source: unix Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: pcre jit disabled Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: detected number of CPU cores: 4 Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: current working directory: / Jul 06 15:12:36.339419 dv-cinder-848848-4-smb devstack@keystone.service[80185]: detected binary path: /usr/bin/uwsgi-core Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: your processes number limit is 47680 Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: your memory page size is 4096 bytes Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: detected max file descriptor number: 2048 Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: lock engine: pthread robust mutexes Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: thunder lock: enabled Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 06 15:12:36.339944 dv-cinder-848848-4-smb devstack@keystone.service[80185]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 15:12:36.382367 dv-cinder-848848-4-smb devstack@keystone.service[80185]: Python main interpreter initialized at 0x55a9393529c0 Jul 06 15:12:36.382367 dv-cinder-848848-4-smb devstack@keystone.service[80185]: python threads support enabled Jul 06 15:12:36.382367 dv-cinder-848848-4-smb devstack@keystone.service[80185]: your server socket listen backlog is limited to 100 connections Jul 06 15:12:36.382367 dv-cinder-848848-4-smb devstack@keystone.service[80185]: your mercy for graceful operations on workers is 90 seconds Jul 06 15:12:36.382694 dv-cinder-848848-4-smb devstack@keystone.service[80185]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 15:12:36.382792 dv-cinder-848848-4-smb devstack@keystone.service[80185]: *** Operational MODE: preforking *** Jul 06 15:12:36.383070 dv-cinder-848848-4-smb devstack@keystone.service[80185]: *** uWSGI is running in multiple interpreter mode *** Jul 06 15:12:36.383070 dv-cinder-848848-4-smb devstack@keystone.service[80185]: spawned uWSGI master process (pid: 80185) Jul 06 15:12:36.383263 dv-cinder-848848-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 06 15:12:36.384804 dv-cinder-848848-4-smb devstack@keystone.service[80185]: spawned uWSGI worker 1 (pid: 80193, cores: 1) Jul 06 15:12:36.384804 dv-cinder-848848-4-smb devstack@keystone.service[80185]: spawned uWSGI worker 2 (pid: 80194, cores: 1) Jul 06 15:12:36.384804 dv-cinder-848848-4-smb devstack@keystone.service[80185]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 15:12:41.775328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:12:41.775328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes Jul 06 15:12:41.776732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:12:41.776732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes Jul 06 15:12:41.777047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:12:41.777047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: from cryptography.utils import int_from_bytes Jul 06 15:12:41.777495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 15:12:41.777495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: from cryptography.utils import int_from_bytes Jul 06 15:12:41.825447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:12:41.825652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:12:41.825867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] command line args: [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:12:41.826181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:12:41.826268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 15:12:41.826378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ================================================================================ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:12:41.826470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 15:12:41.826577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] command line args: [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 15:12:41.826660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.826851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 15:12:41.826937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_dir = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ================================================================================ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 15:12:41.827119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] config_source = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] admin_token = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] debug = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_dir = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.827900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] config_source = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] debug = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.828937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_config_append = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_dir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_config_append = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.829995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_dir = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.830924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.831975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.832835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] publish_errors = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.833938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] publish_errors = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] standard_threads = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.834981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] standard_threads = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_journal = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_json = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_stderr = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.835957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] use_syslog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_journal = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_json = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.836504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_stderr = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] use_syslog = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.836877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 15:12:41.836964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.837951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.838969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.839976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.840928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.841931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.842952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.843990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.844942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.845861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.846960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.847981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.848912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.849938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.850947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.851965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.852885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.853988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.854571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.854755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.854842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.854990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.855933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.856952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.857883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.858871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.859999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.860952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.external = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.861887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.external = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.password = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.token = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.862895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.password = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] auth.token = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.863994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.864936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.865982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.866949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.867933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.868899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.869611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.870903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.871854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.872951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.873973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.874912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.875868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.876978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.877995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.878952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.879914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.880990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.881934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.882952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.883886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.884972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.885959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.886962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.887898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.888999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.889958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.890989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.891934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.892867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.893808 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.894945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.895950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.896901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.897870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.898859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.899876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.900915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.901609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.901690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.901860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.901964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.902895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.903857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.904936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.905988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.906927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.907866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.908974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.909940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.910953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.911892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.912977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.913056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.913128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:12:41.913204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.913433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.913688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.913941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 15:12:41.914105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 15:12:41.943974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.944203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.944425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.944686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.944920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.945149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.952718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.953476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.981879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.982133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.982285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:41.982481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.123960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.124221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.173128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.173362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.173835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.174097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.237251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.237470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.237686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.237823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.237992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.238906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.262614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.262849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.262981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.263936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.264063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.264191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.264324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.264324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.275256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.275413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.288755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.288971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.289999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.290127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.290272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.290404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.290537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.290677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80194) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 15:12:42.307256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.307467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 15:12:42.307947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.308121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.308237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 15:12:42.308321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 15:12:42.308471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.308557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.308670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 15:12:42.308813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.308939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.309070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.309198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.309319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.309455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.309707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.320918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.321086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.321363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.329572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.330193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.332855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.333132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.333407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.333491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.333685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.333779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.333986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.334848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.335817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.336084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.363110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.363733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.364722 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.365003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.365327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.365603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.370323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.370601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.370950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.371035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.371233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.371509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.378319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.378553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.378877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.379156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.383023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.383311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.383589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.383672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.383870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.383954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.384930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.385012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.385188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.386385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.404798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.405074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.405692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.405988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.409638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.410569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.413288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.413582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.414193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.414484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.418757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.419611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.422388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.423219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.426029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.426325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.426610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.426842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.426927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.427975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.428252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.446407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.446694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.446959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.447172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.447270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.447453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.447717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.448496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.455662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.456347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.457365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.457637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.458061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.458334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.460839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.461120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.461396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.461481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.461671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.461756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.462016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.462115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.462291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.462618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.475760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.476014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.476289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.476382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.476564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.476649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.476838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.476923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.477155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.477431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.477717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.478020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.478436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.478733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.496541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.496961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.499854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.500205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.503176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.503495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.504919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.505077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.506580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.506845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.506931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.507118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.507205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.507398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.514978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.515486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.516850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.517074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.520093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.520299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.520384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.520581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.520753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.520839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.521029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.521116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.530676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.530838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.530963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.531122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.531239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.531394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.539098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80194) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.539186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 15:12:42.539377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.539463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.539651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.539735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.539924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.540838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.541935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.542814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80194) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 15:12:42.580557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9393529c0 pid: 80193 (default app) Jul 06 15:12:42.580694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9393529c0 pid: 80194 (default app) Jul 06 15:12:42.583883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50673b-8899-4bd1-8b9e-14cc2de572af None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:42.584171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50673b-8899-4bd1-8b9e-14cc2de572af None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:42.584442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50673b-8899-4bd1-8b9e-14cc2de572af None None] PATH_INFO: `/v3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:42.589281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed Jul 6 15:12:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:50.184404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:50.184973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:50.184973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:50.189227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:12:50.194405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:50.194791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:50.194952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:50.263056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: INFO dbcounter [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] Registered counter for database keystone Jul 06 15:12:50.284627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG oslo_db.sqlalchemy.engines [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:12:50.291015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writer thread running {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:12:50.466459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80193) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 15:12:50.466878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80193) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 15:12:50.521355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:50.523004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:50.642599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 15:12:50.899788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:50.970387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: INFO dbcounter [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] Registered counter for database keystone Jul 06 15:12:50.989401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG oslo_db.sqlalchemy.engines [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 15:12:50.996052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writer thread running {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 15:12:51.114399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264283f-9b3b-463e-a850-89541e999e44 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:51.118668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:51.119327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:51.120127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:51.120413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:51.128459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:51.180271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 15:12:51.180565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff6c8-c306-4a81-b0e2-86f8fe1481da admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:51.190550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Jul 6 15:12:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:12:51.196550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:51.211342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd805fb4-617e-47c5-86fb-e108a1580ac4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:51.215819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:51.216918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:51.217203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:51.217475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] PATH_INFO: `/v3/projects/384fdc49fff9422ba6ec721becb44e7d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:51.218963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] RBAC: Authorizing `identity:get_project(project_id=384fdc49fff9422ba6ec721becb44e7d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:51.272639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING keystone.common.rbac_enforcer.enforcer [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 15:12:51.272977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb83a2-34b5-4e53-a900-74eecf765155 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:51.277495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Jul 6 15:12:51 2022] GET /identity/v3/projects/384fdc49fff9422ba6ec721becb44e7d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:53.273278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a849db-9439-434c-a9ec-f25dbaeb8053 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:53.273818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a849db-9439-434c-a9ec-f25dbaeb8053 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:53.273818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a849db-9439-434c-a9ec-f25dbaeb8053 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:53.278024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:12:53.283549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:53.283969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:53.284111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:53.302641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:53.304162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:53.312673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 15:12:53.335138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a849db-9439-434c-a9ec-f25dbaeb8053 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:53.347122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a849db-9439-434c-a9ec-f25dbaeb8053 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:53.351276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:53.351905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:53.352193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:53.352471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:53.360081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:53.361890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb3370-a0fb-4b45-8e2c-9aac97ad220c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:53.371117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Jul 6 15:12:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:12:53.376275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:53.385155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc94e7-9e18-4f0d-a622-75c5cdf9c5e4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:53.390106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:53.391212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:53.391494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:53.391767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:53.393168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:53.395015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618908c-a7e9-435b-ae16-c1cf900999be admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:53.396558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Jul 6 15:12:53 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:55.451684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156879f3-e7b8-44bb-a749-3fcf43ae75fe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.452218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156879f3-e7b8-44bb-a749-3fcf43ae75fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.452218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156879f3-e7b8-44bb-a749-3fcf43ae75fe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.453573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:12:55.458671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.459075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.459241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.475518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:55.476706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:55.483177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba673d-97d3-4130-8e07-50eb6658bdcc None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.483470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba673d-97d3-4130-8e07-50eb6658bdcc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.483748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba673d-97d3-4130-8e07-50eb6658bdcc None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.485490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:12:55.490398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.490683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.490960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.530631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG passlib.handlers.bcrypt [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80194) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 15:12:55.531044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG passlib.handlers.bcrypt [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80194) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 15:12:55.557947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:12:55.578529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:55.580146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:55.580873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:55.607389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:55.678449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:12:55.689651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70ad2a-4e83-4ac2-b87f-b9f830625ead None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:55.700650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:55.723365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:55.724162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.724452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.724734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.735904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:12:55.747585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:12:55.748468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:12:55.749457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:12:55.754538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:55.800030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7228-7f2a-4a5d-8e5e-9ced0923e609 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:55.802272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:55.836477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:55.837884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:55.838948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.839241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.839524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.855477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dd5e8-bde3-49f3-b891-06093c24132e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:55.888884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:55.889536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:55.889817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:55.890118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:55.891123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:12:55.891425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:55.892818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:55.904889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:12:55.907570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:55.909240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:55.910393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:56.004325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:12:56.006767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777e96-bda7-4e4e-9e24-56baa6307304 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:56.009795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:56.012973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:56.040986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:56.041885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:56.042193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:56.042468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:56.043661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:56.045116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:56.046754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:12:55 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:12:56.051980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:56.065930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:56.109439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e790a-0052-4e8d-92cc-85103e6584cf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:56.143895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:56.144689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:56.144974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:56.145249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:56.148885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a17a-ca0a-442d-b6de-71a2a5a86139 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:56.163813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:56.165301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:56.181557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:56.182886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:56.183168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:56.183438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:56.184632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:12:56.185790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:12:56.186738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:12:56.187718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:12:56.187718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:12:56.187718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:12:56.187718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:12:56.187977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:56.188052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:12:56.188306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:12:56.192949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:56.195444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:56.253171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:56.274509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:56.296378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899b07-cc6a-4fb8-9645-8295919c8aa2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:56.297373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a75c10-ae61-4522-95bf-7453fe3adf3d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:56.330883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:56.331203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:56.331553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:56.331843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:56.331938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:56.332127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:56.332229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:56.332405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:56.332882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:12:56.333232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.domain.id=default, user.id=752e00b3ffc94b3ca8223ee74bcd4983) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:12:56.333336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:56.333539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:56.334689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b693-ac89-4a7b-b520-65c6b3cd56f3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:56.335011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a142d-dab5-4dfa-a981-c01ad44d0410 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:56.342148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Jul 6 15:12:56 2022] GET /identity/v3/role_assignments?user.id=752e00b3ffc94b3ca8223ee74bcd4983&scope.domain.id=default&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:12:56.353175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:12:58.476630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7b4b-eea6-4c45-835e-973ff83140d2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:58.477620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7b4b-eea6-4c45-835e-973ff83140d2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:58.478157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7b4b-eea6-4c45-835e-973ff83140d2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:58.480311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:12:58.486045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd60af-f8bd-4d9c-9a22-5e0da95ca624 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:58.486868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd60af-f8bd-4d9c-9a22-5e0da95ca624 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:58.487348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd60af-f8bd-4d9c-9a22-5e0da95ca624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:58.507849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e1fd60af-f8bd-4d9c-9a22-5e0da95ca624 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:58.509384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e1fd60af-f8bd-4d9c-9a22-5e0da95ca624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:58.577991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:12:58.601284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7b4b-eea6-4c45-835e-973ff83140d2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:58.713011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7b4b-eea6-4c45-835e-973ff83140d2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:58.749154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:58.750428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:58.750925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:58.751405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:58.762457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda585b-01b2-4c54-98ff-fd240546f3a5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:58.763013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda585b-01b2-4c54-98ff-fd240546f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:58.763797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda585b-01b2-4c54-98ff-fd240546f3a5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:58.764183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:12:58.765847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:12:58.773768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:12:58.774996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:12:58.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 13/25] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:12:58.779883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:58.780389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:58.780868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:58.787573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:58.802251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:58.811227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:58.812854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:58.893485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:58.960381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:12:59.009651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f99823-f555-4aa2-87a9-82f3486a488c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.021510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.080015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.080696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.080974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.081250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.082037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:12:59.082343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.083983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.108666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 14/27] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:59.115617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.243875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4409-651d-4061-95ce-83b9ca301b34 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.270647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:59.340487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.341299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.341587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.341865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.361971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.364199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb824b36-7c90-4a76-ba57-0fbfbefe42b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.365936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d20beae4-4251-43bd-8e41-e0ebec47cf20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:12:59.401736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:12:59.402647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:12:59.403433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:12:59.403433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:12:59.403433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:12:59.403433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:12:59.405423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 14/28] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:12:59.407766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbccda-5a68-4c2c-91c0-43c3d4b1ab68 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.408258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbccda-5a68-4c2c-91c0-43c3d4b1ab68 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.408731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbccda-5a68-4c2c-91c0-43c3d4b1ab68 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.410422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 15/29] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:12:59.415420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbccda-5a68-4c2c-91c0-43c3d4b1ab68 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.450106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.451129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.451424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.451702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.452670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:59.454674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.459085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c115e-1793-4b28-a46d-15bdd19b231d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.459085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:12:59 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:59.467751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2653e-9dbc-4076-bdf5-e786e3f63caa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.468381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2653e-9dbc-4076-bdf5-e786e3f63caa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.471729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2653e-9dbc-4076-bdf5-e786e3f63caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.494044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8dc2653e-9dbc-4076-bdf5-e786e3f63caa None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:59.496312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8dc2653e-9dbc-4076-bdf5-e786e3f63caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:59.558724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbccda-5a68-4c2c-91c0-43c3d4b1ab68 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.589839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 16/31] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:12:59.589839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ee88-4084-4f7f-897e-a333d1be6dc2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.589839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ee88-4084-4f7f-897e-a333d1be6dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.589839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ee88-4084-4f7f-897e-a333d1be6dc2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.594325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 17/32] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:12:59.595137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ee88-4084-4f7f-897e-a333d1be6dc2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.625597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.626343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.626627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.626902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.627647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:12:59.627987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.630203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04084c1-a65e-477c-a9ed-36f8a65e8db4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.643148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 16/33] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:59.644510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.644802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.645081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.662631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:12:59.663892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:12:59.676709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:59.718479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ee88-4084-4f7f-897e-a333d1be6dc2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.737711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 17/34] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:12:59.742400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.756188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.757272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.757753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.758281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.759685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.761374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.768216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 18/35] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:12:59.769256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:12:59.777070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:59.873189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d72781-c18f-485a-af01-78c69eccc0d9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.873623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25475-f0c7-4f73-b11a-5fb367855e5b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:12:59.905423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:12:59.910790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.911897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.912480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.913071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.914045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.914985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:12:59.915673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:12:59.915981 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:12:59.916231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:12:59.916724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:12:59.917013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:12:59.918427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.051703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 18/36] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 15:12:59 2022] POST /identity/v3/roles => generated 225 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:00.052576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:00.062075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:12:59 2022] POST /identity/v3/projects => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:00.063865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:00.155931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:00.208696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e76d-bb5c-4e35-9efb-58a5040edeb4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:00.212520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834568a-fae9-4cca-884c-d8052edeaf68 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:00.261430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:00.262173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.263709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.263835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.264613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:00.267502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e039e-3bef-4ce6-8394-1efa4cd4a6a9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.289131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:00.289131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.289131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.289131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] PATH_INFO: `/v3/domains/default/users/752e00b3ffc94b3ca8223ee74bcd4983/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.300681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=752e00b3ffc94b3ca8223ee74bcd4983, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:00.304229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 15:13:00 2022] POST /identity/v3/roles => generated 219 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:00.304361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b33c8-2713-467e-9da6-d498945a1caa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.305433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f69e5-e76a-4f96-b14f-1e2e2b33adbe None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.305549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f69e5-e76a-4f96-b14f-1e2e2b33adbe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.305774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f69e5-e76a-4f96-b14f-1e2e2b33adbe None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.308401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 21/39] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:00.312470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108bad-5805-410e-a7be-fea653386d9e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.312470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108bad-5805-410e-a7be-fea653386d9e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.312470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108bad-5805-410e-a7be-fea653386d9e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.312470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 22/40] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:00.315243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.315243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.315243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.347633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 19/41] 10.222.0.25 () {58 vars in 1361 bytes} [Wed Jul 6 15:13:00 2022] PUT /identity/v3/domains/default/users/752e00b3ffc94b3ca8223ee74bcd4983/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:00.348970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.349180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.349511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.377276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:00.381042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:00.462847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:00.465613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:00.477848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:00.512055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:00.519614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:00.572131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:00.606142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:00.613315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:00.652856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139fb61-0733-40af-a6b6-9b8103fe30d7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:00.690363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:00.691455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.691764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.692050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.692810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:00.694933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.709440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 21/44] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 15:13:00 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:13:00.718621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180897-0bd9-463e-aa1d-c6bf7bde64be None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:00.758561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:00.759635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.760285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.761276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.762721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:00.764248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a2d28-4519-47ee-88ad-67720d26a1bf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.766558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 24/45] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:00.771985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:00.881145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19123a9-6ff0-4c2a-a830-06aa4417c517 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:00.911006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:00.920441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:00.921313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:00.921742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:00.922286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:00.923194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:00.924655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa97244-1ac7-44b9-811a-c80230ac2bfd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:00.954592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:13:00 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:13:02.491170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4eb1b-3b7e-4bbf-9f72-575428458cff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:02.491676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4eb1b-3b7e-4bbf-9f72-575428458cff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:02.491757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4eb1b-3b7e-4bbf-9f72-575428458cff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:02.493100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:02.498487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:02.498907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:02.499046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:02.516765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:02.517967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:02.688787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:02.711490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4eb1b-3b7e-4bbf-9f72-575428458cff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:02.755890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:02.812470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4eb1b-3b7e-4bbf-9f72-575428458cff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:02.846086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:02.846873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:02.847160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:02.847437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:02.857261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b833275a-05ff-4344-81be-c86e8f06c5e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:02.864891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:02.865816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:02.871380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 26/49] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:02.872029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:02.962010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ffed-92b5-4fa6-aa6c-9be4e86e8110 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:02.962300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ffed-92b5-4fa6-aa6c-9be4e86e8110 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:02.962583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ffed-92b5-4fa6-aa6c-9be4e86e8110 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:02.963995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 27/50] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:02.968657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:02.968944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:02.969219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:02.970059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cb774-aa2b-4da4-bf00-5f48442cd5bc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:02.980756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:02.985702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:02.986933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:03.011335 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.012015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.012373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.012652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.013448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:03.013757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.015188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.027375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 24/51] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:03.032768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:03.055431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:03.079693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:03.109154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:03.139248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e7c14-1f0d-496e-8c81-2d4eaf6b2e8f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:03.173585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.174496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.174778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.175057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.176245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.177709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.178526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ff0d5-f21f-4ce5-b84e-b77ffecd5a76 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:03.179372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 25/53] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:03 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:03.185305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:03.212699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.213427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.213714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.214026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.215216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.216655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.218472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 29/54] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:03.223632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:03.226460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:03.285092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc7c8-55d4-47aa-9733-2a1817a2e499 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:03.320276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.321071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.321357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.321630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.322964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.324492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.326128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 26/55] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:03.327620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:03.330857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989810b-6702-42cb-ade7-3e00684650d2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:03.333155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:03.368269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.368920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.369210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.369489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.370766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.372200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4584c-8f70-4978-bd39-46a67a2bd670 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.396887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 30/56] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Jul 6 15:13:03 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:13:03.434538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911ea22-d0ca-4775-a6a3-ff55a3ad3707 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:03.445077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:03.471472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:03.472059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:03.472342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:03.472617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:03.473458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.domain.id=default, user.id=752e00b3ffc94b3ca8223ee74bcd4983) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:03.473769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:03.475562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab908d-8da6-4d53-8c41-ae7c0883ce54 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:03.485362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 27/57] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Jul 6 15:13:03 2022] GET /identity/v3/role_assignments?user.id=752e00b3ffc94b3ca8223ee74bcd4983&scope.domain.id=default&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:05.410941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd257b-c2db-4aaa-806d-fde2f665dd79 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:05.411425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd257b-c2db-4aaa-806d-fde2f665dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:05.411506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd257b-c2db-4aaa-806d-fde2f665dd79 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:05.412879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 31/58] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:05.418468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:05.418868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:05.419021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:05.435371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:05.436553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:05.499761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 28/59] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:05.524191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd257b-c2db-4aaa-806d-fde2f665dd79 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:05.622139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd257b-c2db-4aaa-806d-fde2f665dd79 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:05.655410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:05.656185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:05.656471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:05.656751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:05.657939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:05.659380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9746cf-7955-4b64-a1cd-da4aac666ff6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:05.660966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 32/60] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:05.666367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:05.762905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f58d-803f-4f01-a240-0135ef7bd312 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:05.764367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:05.796917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:05.797578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:05.797858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:05.798163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:05.798870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:05.800320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59612bf4-0ce4-4528-a2ba-cc8b2497fdef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:05.824511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 29/61] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:05 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:09.069598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ce6c0-ac24-4b32-8383-3416ead7fde2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.070592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ce6c0-ac24-4b32-8383-3416ead7fde2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.071115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ce6c0-ac24-4b32-8383-3416ead7fde2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.072175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1bea-d68a-4875-b51a-a97d444f5510 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.072547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1bea-d68a-4875-b51a-a97d444f5510 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.073294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1bea-d68a-4875-b51a-a97d444f5510 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.074083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 33/62] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:09.074970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 30/63] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:09.079309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.079833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.079935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d8590-a76c-46b4-9d83-b75160471133 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.080210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d8590-a76c-46b4-9d83-b75160471133 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.080488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d8590-a76c-46b4-9d83-b75160471133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.080833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.099221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2b9d8590-a76c-46b4-9d83-b75160471133 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:09.100744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2b9d8590-a76c-46b4-9d83-b75160471133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:09.109848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:09.111176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:09.130208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.205614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:09.207478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d13f-7be2-4554-89b0-229ef06fbb14 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.207967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d13f-7be2-4554-89b0-229ef06fbb14 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.208440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d13f-7be2-4554-89b0-229ef06fbb14 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.209935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 32/65] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:09.215416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.215947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.216423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.219209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 34/66] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:09.229365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.248592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:09.250009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:09.336517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:09.342821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.351157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a8229-0bf7-481a-9282-661ce4e28a31 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.368883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.397765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.398968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.399253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.399677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.410749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d367598b-5a85-4593-8917-7908e7be7dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:09.419287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:09.420204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:09.420950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:09.422000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cb567-4ae3-4aab-bd54-b4b8d57dadaf None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.422000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cb567-4ae3-4aab-bd54-b4b8d57dadaf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.422241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cb567-4ae3-4aab-bd54-b4b8d57dadaf None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.427364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 36/69] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:09.428131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cb567-4ae3-4aab-bd54-b4b8d57dadaf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.441972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.461475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e2a3-16c6-4b78-865c-961a29dbb9dc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.500011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.501088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.501372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.501646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.513139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:09.522281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:09.523105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:09.523859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 34/70] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:09.524476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.545556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cb567-4ae3-4aab-bd54-b4b8d57dadaf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.580033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.580816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.581098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.581371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.591291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b9a01a06-1a97-4ce6-95e9-ff5817b21513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:09.598708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:09.599549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:09.600312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:09.602044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 37/71] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:09.604328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82c5-b589-46b0-b4a2-80cb75ff1cc2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.604634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82c5-b589-46b0-b4a2-80cb75ff1cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.605235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d82c5-b589-46b0-b4a2-80cb75ff1cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.605631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.622536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-593d82c5-b589-46b0-b4a2-80cb75ff1cc2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:09.623743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-593d82c5-b589-46b0-b4a2-80cb75ff1cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:09.628439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063da5-bf22-4f8d-9ca5-2f2c2f9154d8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.661833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.662529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.662812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.663084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.663819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:09.664123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:09.665507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:09.673806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:09.674605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.687599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.692841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 38/73] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:09.694248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b703-162a-4b70-a290-2508b35b989a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.694536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b703-162a-4b70-a290-2508b35b989a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.694813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1b703-162a-4b70-a290-2508b35b989a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.700018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 39/74] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:09.700018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1b703-162a-4b70-a290-2508b35b989a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.774541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ee91-70b1-429c-b64c-86ae86f533d7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.805001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1b703-162a-4b70-a290-2508b35b989a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.808321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.808994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.809283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.809565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.810346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:09.810658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:09.812073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:09.820268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 36/75] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:09.824891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.824891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.844510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.845099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.845388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.845666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.846446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:09.846754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:09.848157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb385-a2c4-4020-8de9-3cf4fb07bb00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:09.856939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:09.858128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.858425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.858704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.874060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:09.875234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:09.922123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00e0c5-d113-4bff-af15-03dcf5bee44e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:09.930365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:09.940634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 41/77] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:09.941448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:09.960537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:09.961410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:09.961691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:09.961996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:09.977776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:09.979931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:09.981613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 37/78] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:09.982402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.040355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4bbd0-705b-4c87-bb53-094c65618e8d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.041246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.073710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.074524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.074809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.075084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.076318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.077778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.079427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 42/79] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:10.080188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.085706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abb57-a7c2-4ee3-b430-e98745c5768a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.121117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.121955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.122217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.122490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.123676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.125124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.126912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 38/80] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:09 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:10.127508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.137425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.178091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d4e-6c6d-4635-b54f-2065e2d2f728 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.212040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.212907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.213198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.214106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.215310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.216771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.218443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 43/81] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:10.221648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.227966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0167be-8b17-479a-9b67-c22cdf634310 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.254109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.263094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.263891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.264177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.264452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.275038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:10.283177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:10.284003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:10.284736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 39/82] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:10.285351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.327345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d8205-6131-4e63-aa97-73598d49e338 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.353255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.363357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.364079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.364437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.364727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.384361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09e61-dbc3-451d-9f5c-7cf0b2b8785d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.417697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.418393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.418675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.418954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.419662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.421107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.429781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.431383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.440850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 40/83] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:10 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:10.441857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.493187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.547628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 44/84] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:10.548669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.563960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce866238-e9de-4931-bcc8-246026b2e99f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.583086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.603652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.604349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.604637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.604956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.664269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017038-d55a-4e05-80fd-b2dba82c08ba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.691271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.693046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.706128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.707438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.708202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.708704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.746307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.793555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.795079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:10.822849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:10.823715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.827742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:10.911183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:10.912249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:10.941445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5ed5a-7d28-450a-a982-91918a345848 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:10.990295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:10.991002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:10.991447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:10.991735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:10.992976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:10.993288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:10.995583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.007714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 42/87] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.008575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.020682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.037875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16e4d-7ebd-4913-9351-c73372d15c85 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.071689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.082233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.083534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.084099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.084387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.086323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.088068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.090103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 46/88] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:10 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.091043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.141564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e068ec-e8d7-4850-b388-0bdcb38bd270 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.177450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.178370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.178657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.178935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.180144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.181605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.183371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 43/89] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.184137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.201292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f196-7d02-4443-91b6-ee1aaa0afcf2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.238432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.239302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.239592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.239870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.241064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.242608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.244366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 47/90] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.245163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.269499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.296855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77624489-2341-4030-bb50-b5013d3e09df None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.318636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.332236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.333122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.333409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.333690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.334945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.336401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.338797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 44/91] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.339384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.363503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fccd4-11e4-4ee6-972c-f737b1160819 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.402186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.403122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.403411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.403697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.405178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:11.405540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.407627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.418849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 48/92] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=1801c155c74646c1a128d958c3f795a4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.418996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.467717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96773b53-8c61-40ab-8aad-656712c140aa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.520142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.520821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.521108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.521387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.522267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:11.522586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.525269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.536209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 45/93] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=b2d7b12184614f5997f9ce444f519150 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.537074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:11.552637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.626049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75624a92-96aa-4fd1-bc60-8cdd8fad016d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.662069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:11.671672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.672361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.672650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.672940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.674035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=752e00b3ffc94b3ca8223ee74bcd4983) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:11.674358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.676211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.684135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/role_assignments?user.id=752e00b3ffc94b3ca8223ee74bcd4983&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:11.772734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec45dd-ba3f-4487-b49e-c953b890d71a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:11.825537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:11.826606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:11.827088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:11.827557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:11.931420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:11.933311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:11.942128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:12.051495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:12.057194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:12.208223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622392-d602-43e7-b5ca-1256b6aa181a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:12.244939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:12.245815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:12.246124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:12.246400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] PATH_INFO: `/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:12.247611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] RBAC: Authorizing `identity:get_project(project_id=6ec7ca36f36749b2a7f9e380ee045cf5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:12.249072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1774b-9764-4c7b-a97c-dd2acf1bbd08 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:12.251172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:12 2022] GET /identity/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:12.256825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:12.393053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42720efb-b0a0-4d6b-a7e3-89ae84a6d0d6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:12.401994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:12.441410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:12.442107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:12.442394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:12.442669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:12.443502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=6ec7ca36f36749b2a7f9e380ee045cf5, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:12.443807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:12.445254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65417c-58e7-46d5-85d1-a4f19bf8201f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:12.451812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:12 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=6ec7ca36f36749b2a7f9e380ee045cf5&role.id=b2d7b12184614f5997f9ce444f519150 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:13.021217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81910-e21f-44f1-80fd-8521806c3e2a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.021607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81910-e21f-44f1-80fd-8521806c3e2a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.021780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81910-e21f-44f1-80fd-8521806c3e2a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.023177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:13.028266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7774c7-04a0-49dc-aa5b-06643c1d48c2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.028557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7774c7-04a0-49dc-aa5b-06643c1d48c2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.028836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7774c7-04a0-49dc-aa5b-06643c1d48c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.059072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4f7774c7-04a0-49dc-aa5b-06643c1d48c2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:13.060319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4f7774c7-04a0-49dc-aa5b-06643c1d48c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:13.152322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:13.195376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81910-e21f-44f1-80fd-8521806c3e2a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:13.276683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a9b5-e09c-44e0-b2d5-4bea7b540985 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.277170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a9b5-e09c-44e0-b2d5-4bea7b540985 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.277170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9a9b5-e09c-44e0-b2d5-4bea7b540985 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.279932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 49/100] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:13.281748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:13.286246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.288397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.288397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.319930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:13.321641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:13.357400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81910-e21f-44f1-80fd-8521806c3e2a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:13.423914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:13.424701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.424985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.425259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.443930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:13.455172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:13.457629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:13.458696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:13.459468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:13.461395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 52/102] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:13.467736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:13.499049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:13.533806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:13.685702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba782-0513-4e18-93eb-4c4621a2921f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:13.718718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626dc22-717c-44f6-a248-6be9327bd682 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:13.756843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:13.758262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:13.759048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.759336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.759618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.763344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:13.763678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:13.765088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:13.781599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 51/103] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:13.789378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:13.793480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:13.794315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.794601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.795003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.798131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:13.799727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:13.801363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 53/104] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:13.808004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:13.908059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:13.917757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640757af-a25a-4da3-bb3a-e6f3d2ae04f5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:13.952395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:13.953647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:13.954195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:13.954665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] PATH_INFO: `/v3/users/16ad0a3cc8bb43c782aad32199cd5924` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:13.968745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] RBAC: Authorizing `identity:get_user(user_id=16ad0a3cc8bb43c782aad32199cd5924)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:13.970508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:13.972415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 52/105] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:13 2022] GET /identity/v3/users/16ad0a3cc8bb43c782aad32199cd5924 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:13.979358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:14.008947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323edc0d-e4e3-4907-9f9d-4bc5855c4516 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:14.064622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:14.065259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.065817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.065817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.066576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:14.068023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:14.084286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60274-8ed7-4102-b647-288b91f25d93 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:14.120996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564583d-f461-4460-a334-722807384151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:14.122030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564583d-f461-4460-a334-722807384151 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.122501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564583d-f461-4460-a334-722807384151 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.122934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564583d-f461-4460-a334-722807384151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.126016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 54/106] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:13:13 2022] POST /identity/v3/projects => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:13:14.162665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:14.199938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564583d-f461-4460-a334-722807384151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:14.201757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564583d-f461-4460-a334-722807384151 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:14.308519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:14.313199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:14.360454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:14.442141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255c19-0b0c-4873-ac03-8fc5db161485 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:14.490080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:14.491316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.491838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.492316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.493763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:14.495556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccab71-5772-4e28-aac2-cf36341ce4bb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:14.497809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 55/108] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:14 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:14.503338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564583d-f461-4460-a334-722807384151 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:14.580669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:14.591454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443e11-d7c3-4c9a-a363-3c0aafe4141e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.592035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443e11-d7c3-4c9a-a363-3c0aafe4141e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.592518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443e11-d7c3-4c9a-a363-3c0aafe4141e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.594149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 56/109] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:14.601475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.602056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.602478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.629846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:14.631080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:14.636287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564583d-f461-4460-a334-722807384151 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:14.675044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:14.676072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.676556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.677028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.678098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=16ad0a3cc8bb43c782aad32199cd5924) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:14.678703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:14.680333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527a341-4e53-49ab-8395-bea905a82204 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:14.686445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 54/110] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:14 2022] GET /identity/v3/role_assignments?user.id=16ad0a3cc8bb43c782aad32199cd5924&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:14.735853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:14.757638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e320b-b139-471a-9e78-241db4e528fa None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.758495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e320b-b139-471a-9e78-241db4e528fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.758969 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e320b-b139-471a-9e78-241db4e528fa None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.759162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:14.761319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 55/112] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:14.767097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:14.767664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:14.768143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:14.798996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:14.800587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:14.818570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:14.920722 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 56/113] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:14.931807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f254-8c32-47f3-a4af-ad209cc577af None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:14.946337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.003370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.004534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.005089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.005556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.033303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.035219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0d67147b-d5bc-494f-b26f-5a4de7709711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:15.051584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:15.052462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:15.053208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:15.061090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 58/114] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:15.062761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392d12-6c0e-45a8-b66f-14eb5a413ae2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.065443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392d12-6c0e-45a8-b66f-14eb5a413ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.065953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392d12-6c0e-45a8-b66f-14eb5a413ae2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.068235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 59/115] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:15.070581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17392d12-6c0e-45a8-b66f-14eb5a413ae2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.138004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b5e1a-5638-4a76-9a13-b2c6a909d00a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.183168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.184323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.184818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.185283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.202098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:15.218274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9d222d81-8bc7-4292-bb49-42daa3d22803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:15.218708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:15.219509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:15.220241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:15.222741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 57/116] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:15.224148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.224594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.225075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.229248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17392d12-6c0e-45a8-b66f-14eb5a413ae2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.250949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:15.252455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:15.287227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.287927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.288218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.288502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.289406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:15.289597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:15.291007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:15.313922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 60/117] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:15.313922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.359173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:15.360119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.418242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.482902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897ef4f-eac6-4f70-a18c-7868754ee5ad None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.519732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.520410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.520699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.520983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.521738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:15.522082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:15.523474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:15.523639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816464e-85d1-42a4-9c4f-29e20d08c26b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.534427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:15.535351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.566450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.567064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.567334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.567621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.567897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.569176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:15.570776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fed27-64dd-4e42-a016-6546a561a4e8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:15.573337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 59/120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:15.574633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0722d4-315b-42fc-ad5e-ff73bd98c80e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.574923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0722d4-315b-42fc-ad5e-ff73bd98c80e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.575201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0722d4-315b-42fc-ad5e-ff73bd98c80e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.580732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 60/121] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:15.581462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0722d4-315b-42fc-ad5e-ff73bd98c80e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.656081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d835b9-0f53-4c0b-a1c9-053706b70c57 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.691786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.692594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.692882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.693163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.704465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:15.712297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:15.713126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:15.713893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 62/122] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:15.715003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.719154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0722d4-315b-42fc-ad5e-ff73bd98c80e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.721414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.758229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.759269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.759559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.759865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.761680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:15.763178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d9bd3-289e-48f0-91de-729104aa711a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:15.764881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 61/123] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:15.770764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.771056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.771585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.788620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:15.789815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:15.825507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:15.849511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aafcd9-92c4-4915-b4ec-2cb047567620 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:15.872896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 62/124] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:15.874201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:15.922933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:15.923952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:15.924312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:15.924669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:15.927222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:15.928890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:15.930928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 63/125] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:15.933241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.001756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.005661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0201b2-f05c-4cfd-8cd1-d0b3a0c6b1ef None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.066131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69a3b9-743d-45d4-8eb0-e3a77b8b3c87 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.067450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.068389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.068681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.068964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.070283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:16.074318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.076289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.089131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 63/126] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.089131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.108987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.110002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.110392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.110796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.112078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.113619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.116032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 64/127] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:15 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.116646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.137635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.210955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980815-6faf-4826-97f3-295fa4c35dd5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.241528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e9fb8-98d8-4d57-aaf9-d46b828db21f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.248683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.249675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.250369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.250703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.264113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:16.274591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:16.275433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:16.276215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 64/128] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:16.277354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.280740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.287415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.288041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.288587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/users/9ab00cd064eb43448fa87e10489a3018/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.291922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, user_id=9ab00cd064eb43448fa87e10489a3018, role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.293701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.304391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.316208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 65/129] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:16 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/users/9ab00cd064eb43448fa87e10489a3018/roles/1801c155c74646c1a128d958c3f795a4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:16.317703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.412028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.439219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa914-dd3d-4427-bcbf-73ed7a5f0d13 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.441655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283218-a7f1-4988-afbf-c5c27a4628a2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.498699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.499622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.499906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.500187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/users/9ab00cd064eb43448fa87e10489a3018/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.501272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371700c-d68b-407a-907e-60756332e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.502445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371700c-d68b-407a-907e-60756332e376 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.502939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371700c-d68b-407a-907e-60756332e376 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.503470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371700c-d68b-407a-907e-60756332e376 None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.504945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371700c-d68b-407a-907e-60756332e376 None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.506796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371700c-d68b-407a-907e-60756332e376 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.509013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 65/130] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.510126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371700c-d68b-407a-907e-60756332e376 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.510900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, user_id=9ab00cd064eb43448fa87e10489a3018, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.512399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.538652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 66/131] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:16 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/users/9ab00cd064eb43448fa87e10489a3018/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:16.539502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.669559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.684643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371700c-d68b-407a-907e-60756332e376 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.715843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed86c-30aa-42ee-b2e6-afb77f8f4705 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.743870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.745080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.745364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.745638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.746434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:16.746738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.748193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.756305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.757528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.758051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.758568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.760784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.762520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.763347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 66/132] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.764854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 67/133] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.771897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.772442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:16.782674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:16.885687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5932c-aa59-41bb-9045-fe4cd41e3d8d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.924447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030111-1688-491e-8467-e1b1c60b93bb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:16.931204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.932804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.933131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.933409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/users/752e00b3ffc94b3ca8223ee74bcd4983/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.937015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, user_id=752e00b3ffc94b3ca8223ee74bcd4983, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.938521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a41cf-f6ef-4a2a-8ed3-4d4d08530c4d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.959441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 68/134] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:16 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/users/752e00b3ffc94b3ca8223ee74bcd4983/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:16.960809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7586-92ce-4d7d-8ea1-fd89a90e20b9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.961162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7586-92ce-4d7d-8ea1-fd89a90e20b9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.961443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7586-92ce-4d7d-8ea1-fd89a90e20b9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.963150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 69/135] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:16.971065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.971394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.971679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.978190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:16.979632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:16.979920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:16.980195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:16.981406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:16.982945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:16.989218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 67/136] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:16.990239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:17.000537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:17.001971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:17.038486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:17.119171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:17.146084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 70/137] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:17.189020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:17.210626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dadf-5cfb-463b-8f8a-614487a95d21 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:17.257619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:17.258552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.258844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.259125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] PATH_INFO: `/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.260396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] RBAC: Authorizing `identity:get_project(project_id=6ec7ca36f36749b2a7f9e380ee045cf5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:17.263108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c8c01-8cc8-4ed0-8fce-01df2a3e9328 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:17.266144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 68/138] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:16 2022] GET /identity/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5 => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:17.267681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617dce-9f27-4578-ae32-ae00d1fa4d8d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.267971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617dce-9f27-4578-ae32-ae00d1fa4d8d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.268254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617dce-9f27-4578-ae32-ae00d1fa4d8d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.273735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 69/139] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:17.277012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6617dce-9f27-4578-ae32-ae00d1fa4d8d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:17.363946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cc8ad-f8c7-4533-b690-4848950e8692 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:17.400297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:17.415343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6617dce-9f27-4578-ae32-ae00d1fa4d8d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:17.453098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:17.454041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.454321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.454594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] PATH_INFO: `/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5/users/9ab00cd064eb43448fa87e10489a3018/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.456605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ec7ca36f36749b2a7f9e380ee045cf5, user_id=9ab00cd064eb43448fa87e10489a3018, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:17.458292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:17.464194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:17.465364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.465666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.469622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.470620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:17.472590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8527c-3aba-4632-908b-89d71562232d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:17.474792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 71/140] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:17.476482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.476971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.477495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.488657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 70/141] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:17 2022] PUT /identity/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5/users/9ab00cd064eb43448fa87e10489a3018/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:17.490676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:17.515038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:17.518164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:17.676673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:17.697159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 72/142] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:17.723325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ca70-18fc-4d59-9a07-9ca3c2194a89 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:17.733311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:17.766942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:17.767960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.768443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.768915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.769853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:17.771522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:17.825941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 71/143] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:17 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:17.918315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a29d2-57df-4b4f-9b31-91279d462a49 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:17.971755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:17.972947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:17.973484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:17.973983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:17.991093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:18.000025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:18.000900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:18.001699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:18.004185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 73/144] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:18.010797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:18.015233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:18.145046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099df1c-0ab4-45b3-9714-05a37a1ff8e4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:18.183862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:18.184548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:18.184827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:18.185107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:18.185872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:18.186210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:18.187622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:18.198373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 72/145] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:18.202746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:18.282447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:18.322167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621bac-5d1f-48d6-ba0b-ce464945a33a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:18.357345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:18.358271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:18.358544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:18.358810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] PATH_INFO: `/v3/users/16ad0a3cc8bb43c782aad32199cd5924` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:18.360027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] RBAC: Authorizing `identity:get_user(user_id=16ad0a3cc8bb43c782aad32199cd5924)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:18.361485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:18.363318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 74/146] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:18 2022] GET /identity/v3/users/16ad0a3cc8bb43c782aad32199cd5924 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:18.368620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:18.462449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:18.499670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cc6d-d504-4abb-9653-8c7e9d7e9573 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:18.537269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:18.538121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:18.538406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:18.538682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:18.539865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:18.541346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18e6e8-1426-498a-914f-e0ff880c310a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:18.543444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 73/147] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:18 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:18.548882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:18.667602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1745cb2-3bc4-4746-97e9-25b93a41d496 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:18.692729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:18.705366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:18.706731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:18.707211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:18.707693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/users/16ad0a3cc8bb43c782aad32199cd5924/roles/ae7e960f125a4a18a06696bc0a7e91e2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:18.709882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, user_id=16ad0a3cc8bb43c782aad32199cd5924, role_id=ae7e960f125a4a18a06696bc0a7e91e2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:18.711701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b12c89-8612-4ead-b6c5-6722a8510194 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:18.728714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 75/148] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:18 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/users/16ad0a3cc8bb43c782aad32199cd5924/roles/ae7e960f125a4a18a06696bc0a7e91e2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:19.448286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920c2-d3d5-489a-96e1-e1b79a526519 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.448672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920c2-d3d5-489a-96e1-e1b79a526519 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.448846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920c2-d3d5-489a-96e1-e1b79a526519 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.450471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 74/149] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:19.455475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.456003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.456495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.477930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:19.479990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:19.513199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc9a6-0890-4a08-8987-64f8d26e239b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.514153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc9a6-0890-4a08-8987-64f8d26e239b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.514656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc9a6-0890-4a08-8987-64f8d26e239b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.520324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 75/150] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:19.522092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.522593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.523098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.548366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:19.549938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:19.570783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 76/151] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:19.598288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:19.659655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 76/152] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:19.692116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:19.736250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e9e6-9cd2-4d37-8344-e53d19b4f947 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:19.754262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:19.787539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:19.788363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.788645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.788915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.794382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:19.803875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:19.815138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:19.816088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:19.816875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 77/153] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:19.822037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:19.851683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4cb53-ca09-4fa0-a01c-9a1382eeef6e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:19.918677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:19.919503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:19.919837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:19.920123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:19.936322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:19.948881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:19.949747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:19.950534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 77/154] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:19.958915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:19.970459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b91bf-1822-490b-b329-d9fc1cc7bc8b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.021302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.021999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.022333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.022608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.023364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:20.023665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.025052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.038806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 78/155] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:20.044022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:20.114386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:20.115483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f839c0-0eaa-425b-b535-b8f0eb303fef None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.147644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:20.158337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.159183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.159471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.159821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.160592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:20.160902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.162404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.178154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 78/156] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:20.184310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:20.192515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc599ba-1c7f-4aa1-ad3f-9d2cd3a01530 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.247586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.248479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.248762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.249039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.250287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.251747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.253365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 79/157] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:20 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:20.260994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:20.349002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a094c-d3bf-4111-81e9-f0baf7f4058d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.408434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.409314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.409598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.409877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.411198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.412662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.415313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 79/158] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:20 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:20.420377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:20.428607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dc94c-e5fb-4b11-aa55-bcb0414f45d3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.430258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:20.475221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.475884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.476164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.476436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.515282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:20.585893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b98d-3a22-4bb5-8ff3-9c3f4fde2271 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:20.607567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.609040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d9669-1bfc-4484-9110-0dc12c4c6ac9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.664453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:20.665024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.665302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.665574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.840880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:20.842409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:20.862339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:20.863680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316580-93b9-4407-8484-c6b1142e521c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.863962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316580-93b9-4407-8484-c6b1142e521c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.864234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83316580-93b9-4407-8484-c6b1142e521c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.865483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 81/160] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:20.878951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:20.879217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:20.879489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:20.886166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:20.917169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:20.918294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:20.953474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.005223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:21.006056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.084573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 82/162] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:21.085435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.131800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c4df-15a2-4709-a978-dbf14c008112 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.186277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.187460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.187894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.188314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.189649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:21.191361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:21.193410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 81/163] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:21.194312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.225237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.312243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94ddf-5781-49ac-86c7-851cd79a3d19 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.328688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae0522-b17b-4343-a48d-5ee6ed09cc28 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.349431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.350579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.351110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.351578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.370461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:21.380923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:21.384619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:21.386302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:21.387246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:21.394271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.395499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.396029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.396452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.396610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 82/164] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:21.397523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.403499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:21.406687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:21.409286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 83/165] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:21.415510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.570696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.608547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2f27-cdbc-447a-9bcd-e84b7d7b92b3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.624375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916b2e0-3f94-4e66-b16e-cfb417d41655 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.658789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.659789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.660369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.660866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.662300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:21.662869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:21.664681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:21.671922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=1801c155c74646c1a128d958c3f795a4 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:21.673096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.682716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.683404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.683690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.683954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.684815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:21.685107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:21.686606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f546ed-9df0-4213-971f-1e7b34188f96 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:21.698531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 84/167] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=b2d7b12184614f5997f9ce444f519150 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:21.699893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade86-ca42-4d50-86ea-cd5bf63f315c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.700102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade86-ca42-4d50-86ea-cd5bf63f315c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.700355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade86-ca42-4d50-86ea-cd5bf63f315c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.701575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 85/168] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:21.711487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.711798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.712043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.753938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:21.753938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:21.799014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3958b-2b68-4544-a8bf-ca1981f78db3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:21.838680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:21.839806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:21.840294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:21.840774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:21.841760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:21.842326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:21.844182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:21.854831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 84/169] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:21.863039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:21.888574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.895679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:21.914058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 86/170] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:21.958144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.052384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a3ed-0d49-4525-a8e1-891f32fc32ce None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.117991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9a6e7-d0ad-4fe1-9217-c5acc9ec63cf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.130137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.131033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.131315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.131592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] PATH_INFO: `/v3/users/752e00b3ffc94b3ca8223ee74bcd4983` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.132809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] RBAC: Authorizing `identity:get_user(user_id=752e00b3ffc94b3ca8223ee74bcd4983)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:22.134303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:22.137135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 85/171] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/users/752e00b3ffc94b3ca8223ee74bcd4983 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:22.143128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.203174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.203985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.204267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.204543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.228952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:22.239358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:22.240244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:22.241068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:22.248080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.319352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:22.362301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4de3-22da-4be1-91c3-aa9746c834ad None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.396760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:22.423923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.424592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.424874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.425154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.496617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a13-bb18-43b6-8350-fa6a4f58929e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.515093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:22.516817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a535fe6-9b3f-4539-aabb-c2cc770f4438 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:22.564581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.566274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.566791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.567508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.568494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:22.569184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:22.571167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535432-cdac-4458-b6fe-77dbd310f691 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:22.584148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 88/173] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:22.585698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1376-29e3-4bc7-9cfd-cae78d4677b7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.586211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1376-29e3-4bc7-9cfd-cae78d4677b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.586925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1376-29e3-4bc7-9cfd-cae78d4677b7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.589045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 89/174] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:22.590360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c610-405a-4b5a-8cae-9c2a6ec94a23 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.590844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c610-405a-4b5a-8cae-9c2a6ec94a23 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.591378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c610-405a-4b5a-8cae-9c2a6ec94a23 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.592775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 90/175] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:22.597393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c610-405a-4b5a-8cae-9c2a6ec94a23 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.608967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:22.636440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 86/176] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:22.638092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc628e-f38a-48db-a650-c6eb52118e71 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.638756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc628e-f38a-48db-a650-c6eb52118e71 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.639121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc628e-f38a-48db-a650-c6eb52118e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.656449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-20fc628e-f38a-48db-a650-c6eb52118e71 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:22.657697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-20fc628e-f38a-48db-a650-c6eb52118e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:22.733931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 87/177] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:22.733931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.733931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.733931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.735384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c610-405a-4b5a-8cae-9c2a6ec94a23 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.758351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:22.759809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:22.762840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:22.784011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.785144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.785565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.786100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] PATH_INFO: `/v3/users/9ab00cd064eb43448fa87e10489a3018` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.787542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] RBAC: Authorizing `identity:get_user(user_id=9ab00cd064eb43448fa87e10489a3018)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:22.789321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:22.791772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 91/178] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/users/9ab00cd064eb43448fa87e10489a3018 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:22.792755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.845164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 88/179] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:22.845164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:22.899950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:22.928142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93a4a-2c0a-4f31-8866-73955063300e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.968649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f985a-488a-41ac-801e-c3a40b77f040 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:22.975171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:22.977233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:22.977720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:22.978262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:22.980955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:22.982879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:22.986038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 92/180] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:22.987246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.006729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.007534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.007811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.008082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.019155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:23.026779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:23.027705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:23.028471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 89/181] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:23.029103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.053381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.107339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aba72-0089-4a26-9268-fe9af3daee2f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.131490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.138217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5a5c4-12d5-4042-a35a-a281eb1d78ab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.147793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.148451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.148729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.149003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.174595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.175398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.175680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.175958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.186822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:23.194344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:23.195216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:23.196176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 90/182] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:23.197132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.224250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.225723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb79a5-6384-4d40-a0e3-e6fe1e927fb9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.274809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.294752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3197-8622-42bf-9ac1-d0cd516679b4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.330625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.331279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.331560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.331831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.332004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 93/183] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:23.335153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=752e00b3ffc94b3ca8223ee74bcd4983) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:23.335153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.335310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07314f6-3204-4c15-9d65-d59b8d9ba6e7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.335310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07314f6-3204-4c15-9d65-d59b8d9ba6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.335310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07314f6-3204-4c15-9d65-d59b8d9ba6e7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.335497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd98390-8520-437b-9479-49daf48f3c44 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.335572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 94/184] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:23.336259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07314f6-3204-4c15-9d65-d59b8d9ba6e7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.342867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 91/185] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/role_assignments?user.id=752e00b3ffc94b3ca8223ee74bcd4983&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.344554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc49fb-88b6-4943-9e16-cf9a0eab0cf7 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.344846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc49fb-88b6-4943-9e16-cf9a0eab0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.345190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc49fb-88b6-4943-9e16-cf9a0eab0cf7 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.346910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 92/186] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:23.347452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc49fb-88b6-4943-9e16-cf9a0eab0cf7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.372300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.458307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07314f6-3204-4c15-9d65-d59b8d9ba6e7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.471608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc49fb-88b6-4943-9e16-cf9a0eab0cf7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.498317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.499165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.499280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.499979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.500281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:23.500585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.503751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.512316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.512746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 95/187] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.513063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.513348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.513552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.513647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.514384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:23.514682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.516499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6929a-029c-4760-827e-4ab761df2053 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.526726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 93/188] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.528102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9143-3e4b-44d4-ba9b-e775fffd1d25 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.528395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9143-3e4b-44d4-ba9b-e775fffd1d25 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.528674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9143-3e4b-44d4-ba9b-e775fffd1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.531534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.547592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b36b9143-3e4b-44d4-ba9b-e775fffd1d25 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:23.551088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b36b9143-3e4b-44d4-ba9b-e775fffd1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:23.619707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:23.628066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2444b8-cdec-4990-89ee-c15f9564e165 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.628159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.628159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.628159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.645320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:23.646515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:23.654554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.655367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.656266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.656559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.656798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] PATH_INFO: `/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.658128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=6ec7ca36f36749b2a7f9e380ee045cf5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.659592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.661287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 96/190] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/projects/6ec7ca36f36749b2a7f9e380ee045cf5 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.662065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.718883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 95/191] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:23.719626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.756899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.776818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3659-0c1e-458e-98a4-db56a3684ed4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.809681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.810566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.810846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.811120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.816819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c09c5-d95d-4f7a-a48e-ef3b0b695c17 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.824443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.825917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.827571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.828329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.851926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.852790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.853068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.853338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] PATH_INFO: `/v3/users/16ad0a3cc8bb43c782aad32199cd5924` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.854541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] RBAC: Authorizing `identity:get_user(user_id=16ad0a3cc8bb43c782aad32199cd5924)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:23.855973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:23.857584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/users/16ad0a3cc8bb43c782aad32199cd5924 => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:23.862667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.874081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.924360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0116d-6286-43a3-adfe-13e5adcf76c1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.958388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.959177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.959454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.959556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c38869-ae78-4d23-9f5a-3cfae1aaf717 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:23.959722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.966940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:23.970657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:23.980366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:23.981245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:23.982054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:23.982697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:23.997861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:23.998551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:23.998827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:23.999099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:23.999931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=6ec7ca36f36749b2a7f9e380ee045cf5, user.id=9ab00cd064eb43448fa87e10489a3018) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:24.000239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.001669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.007569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 97/195] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/role_assignments?user.id=9ab00cd064eb43448fa87e10489a3018&scope.project.id=6ec7ca36f36749b2a7f9e380ee045cf5&role.id=b2d7b12184614f5997f9ce444f519150 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.008253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.090192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632116-9f49-461f-86e1-73f24694557d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.092088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.118652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8d3c-567e-4132-8381-8599e3fb7c9f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.128885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.129797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.130114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.130386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.131719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.133197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.140092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 99/196] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.140092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.164848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.165516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.165791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.166097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.218495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.244116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.246081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.254481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810d92a-ab94-4b02-b0cc-b14bb073cca2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.289527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.290203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.290484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.290759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.318708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.344277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 98/197] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:24.345181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.364676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.366169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.430022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.443055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a47957-6d27-4479-a01a-0dfafa4b1a13 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.463789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 100/198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:24.464590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.477805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.478498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.479284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.479557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.480302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:24.480605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.482025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.490040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 99/199] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.490814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.528349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.559566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea037cc-0728-413a-a3ab-44cfef97ee16 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.591322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de9c2-7575-432b-9874-4b6026df5f69 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.591633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.592296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.592579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.592853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.593564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.595033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.621174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 101/200] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:24 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:24.622200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.646503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.647403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.647740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.648017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.649310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.650421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.651385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.658291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 100/201] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.658291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.744395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05fcb5-71c0-4e47-a005-d32d29c466cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.770651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45605089-6a81-48b5-ade8-d6c847a96e8a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.772479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.786052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.788119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.788119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.788119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.788561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.790051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.792317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 102/202] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.793881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.808568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.809545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.809833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.810154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.812554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.814044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.815672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 101/203] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.816421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.911457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:24.918280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13911d17-ef86-4d67-9d74-1d547e2ad932 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.944650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0b6be-5d00-4e50-89a8-bfe03f7807b0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:24.959024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.959210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.959415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.959804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.960740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=ea8cbe51d18141699c20356f72301f34) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:24.961073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.962551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.969495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 103/204] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/role_assignments?user.id=ea8cbe51d18141699c20356f72301f34&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:24.970128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:24.985169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:24.985842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:24.986176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:24.986520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:24.987370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, scope.project.id=8107613fb0b446c89653731516ee4f99, user.id=16ad0a3cc8bb43c782aad32199cd5924) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:24.987730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:24.989221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:24.996874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 102/205] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/role_assignments?user.id=16ad0a3cc8bb43c782aad32199cd5924&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:25.101562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a9ae0-6a2f-4eec-bbe9-2a954e08a6b0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:25.139978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:25.141167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:25.141593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:25.142045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:25.191620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:25.222004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:25.223489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:25.333462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 104/206] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:25.339397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:25.383479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:25.460198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bf63-5b09-430f-ab8c-82def7d31087 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:25.498170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:25.499399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:25.499886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:25.500382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:25.501871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:25.503695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ebc75-9c82-4c2d-a653-16f8c9ba051e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:25.506006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 103/207] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:25 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:25.515010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:25.581290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:25.631341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94950319-0ea6-4d9b-98fa-66a18e0d8720 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:25.666781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:25.667352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:25.667630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:25.667899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:25.668741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=ea8cbe51d18141699c20356f72301f34) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:25.669051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:25.670527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584af339-26a6-4107-9a44-d1655f2430b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:25.676167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 105/208] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:25 2022] GET /identity/v3/role_assignments?user.id=ea8cbe51d18141699c20356f72301f34&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=1801c155c74646c1a128d958c3f795a4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:26.885770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c9f4-d292-4bc0-946a-e2c04d395702 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:26.886315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c9f4-d292-4bc0-946a-e2c04d395702 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:26.886423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c9f4-d292-4bc0-946a-e2c04d395702 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:26.888034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 104/209] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:26.893707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:26.894123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:26.894289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:26.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:26.913024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:26.978107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da1d3-37da-4b92-9cc6-1df3d546c4c9 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:26.978411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da1d3-37da-4b92-9cc6-1df3d546c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:26.978713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da1d3-37da-4b92-9cc6-1df3d546c4c9 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:26.980594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 105/210] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:26.985129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 106/211] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:26.985929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:26.985929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:26.986679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.003086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:27.004305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:27.010208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.062271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.076978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:27.102187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.114492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059d136-6606-4f63-b05b-73fa24cc42d9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.137835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.149499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.151218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.152221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.153151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.164154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7baf2899-58b1-42a1-bcef-045977ae5833 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:27.172785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:27.173627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:27.174430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:27.180487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 107/213] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:27.180487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132c80-7de8-4d9e-93c9-124cb87f012a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.180487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132c80-7de8-4d9e-93c9-124cb87f012a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.180487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98132c80-7de8-4d9e-93c9-124cb87f012a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.180487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 108/214] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:27.182610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98132c80-7de8-4d9e-93c9-124cb87f012a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.211275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350ee0-4de5-445e-9373-df27a962f4e3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.250840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.252005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.252469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.252944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.254308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.255899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6ce42-cadd-4297-9072-1f366614d42b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.258044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 107/215] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:27.259406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.259696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.260548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.278479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:27.280083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:27.304786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98132c80-7de8-4d9e-93c9-124cb87f012a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.315768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.341755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.342450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.342850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.343128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.344006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:27.344361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.345836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.359790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 109/216] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:27.359790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.369938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 108/217] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:27.369938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.402331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.475982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9b6e-df6f-45a2-95ea-233506d9f628 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.476211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968027a-7269-499d-bc53-c414e5b090dd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.509514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.510843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.511125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.511400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.512102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.513537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.519527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.520391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.520666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.520926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] PATH_INFO: `/v3/users/5b2f5941737d4f1194ad4ce400985c44` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.536115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f5941737d4f1194ad4ce400985c44)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.546285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 110/218] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:27 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:27.546480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.546558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.546629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 109/219] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/users/5b2f5941737d4f1194ad4ce400985c44 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:27.553408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.567942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.657329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a48af-2e35-4f14-9965-5eb8b654a26d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.690451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.696001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.696805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.697085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.697352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.702326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146bd56-24d8-4a4d-8541-b96af6be8674 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.709590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:27.717330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:27.718310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:27.719091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 111/220] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:27.726962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:27.743622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.744825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.745109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.745380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.829857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.832874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.835107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.849523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388352-b069-4f65-afc0-ce0c8d69cf21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:27.900859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:27.901509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.901790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.902097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.902857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:27.903160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:27.904554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263cd5-3f0f-4efa-b91c-40d76eb54884 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:27.914915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 112/221] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:27.916225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809fcf-d14f-4fe9-84c7-5ceb8d959a36 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.916512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809fcf-d14f-4fe9-84c7-5ceb8d959a36 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.916783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809fcf-d14f-4fe9-84c7-5ceb8d959a36 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.918280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 113/222] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:27.923441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:27.923728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:27.924002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:27.943878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:27.945533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:27.956077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:27.969061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:27.969919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.029094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 114/224] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:28.031036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.120624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12dd84-f768-4676-a2de-f3bbb59c54aa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.132432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:28.153656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73436-b97e-40fa-996e-0380505722d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.167334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.168135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.168415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.168691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.170437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.172204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.174460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 111/225] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:27 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.175050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.194340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.195535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.196033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.196562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.198171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.199931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.202198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.203285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.248362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:28.301400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5ce19-331a-4f50-b33d-1e5f442b655a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.317395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c962d76-7457-4007-a109-1fe46e898fbd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.343476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.344553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.344836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.345110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.355661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.356787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.357300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.357848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.357986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:28.359377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.361147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.363153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 116/227] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.364119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:28.366164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:28.367048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:28.367836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:28.372852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:28.373649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.389970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:28.488038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e021a-0c92-4e0f-87d3-f22006a654fd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.492493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822cec-58c9-48e3-9fec-787c883c8039 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.506823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:28.527701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.529070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.529581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.530104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/ea8cbe51d18141699c20356f72301f34/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.532353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, user_id=ea8cbe51d18141699c20356f72301f34, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.534065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.534720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.535581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.535903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.536218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.537056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=5b2f5941737d4f1194ad4ce400985c44) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:28.538168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.539826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.547462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/role_assignments?user.id=5b2f5941737d4f1194ad4ce400985c44&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=b2d7b12184614f5997f9ce444f519150 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.548498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.559891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 113/230] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:28 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/ea8cbe51d18141699c20356f72301f34/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:28.650855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:28.674600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255f6a-6e79-4c0f-9ddc-f4d33e3e1183 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.721730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.722756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.723185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.723708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.724621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:28.725091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.726785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.741512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.751102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:28.876203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59dbb-837e-4bba-abdd-09a4b683f35c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:28.912213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:28.913099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:28.913378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:28.913648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:28.914873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:28.916370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:28.918019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:28.923478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:29.048581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd48f7b-175c-4ce0-856a-cbd3fb40f779 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:29.094607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:29.095755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.096242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.096685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:29.098126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:29.099743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b31a26-689a-4448-9a1c-e230087295d7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:29.101936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:28 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:29.108204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:29.158726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:29.220232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def21c-4433-4aa6-83ca-08b4f9243985 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:29.260190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:29.261380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.261836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.262300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/ea8cbe51d18141699c20356f72301f34/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:29.264707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, user_id=ea8cbe51d18141699c20356f72301f34, role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:29.266624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecaeb5-ceb1-4bbe-8dbf-3f831194c270 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:29.294044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:29 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/ea8cbe51d18141699c20356f72301f34/roles/1801c155c74646c1a128d958c3f795a4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:29.835772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c248a-e805-470a-bc80-a34887fb7770 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.836492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c248a-e805-470a-bc80-a34887fb7770 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.836972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c248a-e805-470a-bc80-a34887fb7770 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:29.839197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:29.844706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986514-fe95-4a64-b3eb-990acbf4f16d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.845213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986514-fe95-4a64-b3eb-990acbf4f16d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.845687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986514-fe95-4a64-b3eb-990acbf4f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:29.867111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c8986514-fe95-4a64-b3eb-990acbf4f16d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:29.868622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c8986514-fe95-4a64-b3eb-990acbf4f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:29.939073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:29.974227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c248a-e805-470a-bc80-a34887fb7770 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:29.988458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:29.989438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45cc8-fa6f-4d9a-bf8c-f78aa405ef79 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.989721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45cc8-fa6f-4d9a-bf8c-f78aa405ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.990076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45cc8-fa6f-4d9a-bf8c-f78aa405ef79 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:29.991646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:29.997228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:29.997706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:29.998029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.017933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:30.018166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:30.049643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:30.099524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 118/238] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:30.115552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c248a-e805-470a-bc80-a34887fb7770 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.130880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:30.162643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.163450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.163737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.164014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.185197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:30.192906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:30.193765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:30.194587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:30.198584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 121/239] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:30.206785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:30.253056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16dc04-4cfc-492b-96cd-99197ca9853b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.346315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:30.354217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072c334-f472-4a54-a3e6-a1e39be71a18 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.390204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.391400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.391818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.392226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.393119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:30.393572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:30.394595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.395348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:30.395461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.395680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.395960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.403406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:30.404849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:30.405452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 122/240] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:30.410083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 119/241] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:30.414851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:30.419790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:30.513199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:30.551560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575eb1-d0a1-41c3-b0fd-7864ee0cced1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.616319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:30.629258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.630255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.630709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.631148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.633073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:30.635475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:30.651703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6c47-e247-40ae-bde4-a93f709a1d9a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.666389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 123/242] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:30 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:30.709540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.710455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.710739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.711013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] PATH_INFO: `/v3/users/3f7a54e1a57e4f88bec65f7439540c99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.727260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7a54e1a57e4f88bec65f7439540c99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:30.728773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:30.730561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 120/243] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:30 2022] GET /identity/v3/users/3f7a54e1a57e4f88bec65f7439540c99 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:30.736352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:30.848979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e92858-d24c-4e91-96da-1b0a628109ef None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:30.887179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:30.887765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:30.888047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:30.888331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:30.950512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:30.963462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:30.965083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:31.070259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 124/244] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:31.075901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.172141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:31.181567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526169e8-6a9a-4b27-a45c-795092e69bb9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:31.216962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:31.217828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.218149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.218422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.219615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:31.221060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e281da3-9d09-4222-80d5-067284f65995 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:31.222799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 121/245] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:31.229243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.234573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c75ec-24d3-4f14-8ed8-57d79ccec145 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.234867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c75ec-24d3-4f14-8ed8-57d79ccec145 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.235150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c75ec-24d3-4f14-8ed8-57d79ccec145 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.236674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 122/246] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:31.242002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575caf96-a6a1-4667-b398-5f8038779721 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.242299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575caf96-a6a1-4667-b398-5f8038779721 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.242579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575caf96-a6a1-4667-b398-5f8038779721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.268866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-575caf96-a6a1-4667-b398-5f8038779721 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:31.270296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-575caf96-a6a1-4667-b398-5f8038779721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:31.378940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:31.386239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 123/247] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:31.396477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117453-2fc0-4a51-869d-16a8c4d04400 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.396769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117453-2fc0-4a51-869d-16a8c4d04400 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.397049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117453-2fc0-4a51-869d-16a8c4d04400 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.398573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 124/248] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:31.404583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.404908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.405142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.405310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980572-7fc2-4cac-8cba-5f99d518a2ca None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:31.430569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:31.432978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:31.450219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:31.450880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.451318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.451599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.452812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=3f7a54e1a57e4f88bec65f7439540c99) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:31.453126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:31.454893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:31.462443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 125/249] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/role_assignments?user.id=3f7a54e1a57e4f88bec65f7439540c99&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:31.463619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.534811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 125/250] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:31.605358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.624112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d9abb-da1a-41d7-bf4e-20ca53269793 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:31.648575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:31.688249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:31.689443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.689989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.690500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.714618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:31.726876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:31.727807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:31.728612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:31.735617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 126/251] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:31.741267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.776634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:31.789780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d73f-61b4-4af2-b54a-ad61f38e77c9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:31.850620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:31.851441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.851731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.851994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.877807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:31.886516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:31.887383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:31.888154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:31.895875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 126/252] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:31.902299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:31.916369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f39-6602-49d5-af92-7b7cba3da6ae None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:31.983396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:31.984433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:31.984934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:31.985466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:31.986443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:31.986941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:31.988700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74723b94-bab5-478d-911b-e90bd959cd59 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.007823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 127/253] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:32.012872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782e2b-ebc9-4cc8-b52a-14bdce61d19b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.013166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782e2b-ebc9-4cc8-b52a-14bdce61d19b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.013441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782e2b-ebc9-4cc8-b52a-14bdce61d19b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.014797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 128/254] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:32.021134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782e2b-ebc9-4cc8-b52a-14bdce61d19b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.034309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.062471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3893-bd26-41c3-9ff2-2955fd748151 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.097864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.098564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.098847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.099122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.099875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:32.100184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.101583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d19de-1b9b-49c7-ab58-89ec7089c94e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.110759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 127/255] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:32.112097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.112500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.112784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.129187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:32.132046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:32.187293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.200935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 128/256] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:32.201883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.245393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782e2b-ebc9-4cc8-b52a-14bdce61d19b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.273515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.315316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab257-78e6-46e7-acf9-6db9b80652b9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.351325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.352351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.352760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.353120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.354563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.355334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.356273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.356519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.356956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.357367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] PATH_INFO: `/v3/users/5b2f5941737d4f1194ad4ce400985c44` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.360999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 129/257] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:32.360999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.362067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f5941737d4f1194ad4ce400985c44)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.363661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.365437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 129/258] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/users/5b2f5941737d4f1194ad4ce400985c44 => generated 297 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:32.372298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.469756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb160-ce34-4b6a-90cd-63e386674176 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.512963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.513989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.514377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.514756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.526066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.532032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:32.551211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:32.552113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:32.552882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 130/259] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:32.554363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.625506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81195b13-b1dc-4c2b-865e-d3823e7cee6f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.708001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169af04-cae7-47b8-b40e-a56ed2de2fa9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.750837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.751717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.752005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.752279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.753750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.755251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.762341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.763103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.763346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.763627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.764807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 131/260] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:32.765886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:32.786269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.882919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.884791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.905523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:32.946702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dee76-9c6a-4d3a-aae3-5b0fd0f0b4f0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:32.984876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:32.985934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:32.986413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:32.986897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:32.987841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:32.988337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:32.989963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:32.998639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 132/261] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:32.999646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:33.105010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bbed-03bb-4a6a-9ad8-44464f794e2f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:33.138270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:33.147300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:33.148405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:33.150099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:33.151200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/5b2f5941737d4f1194ad4ce400985c44/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:33.153414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, user_id=5b2f5941737d4f1194ad4ce400985c44, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:33.155388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:33.169305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 133/263] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:32 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/5b2f5941737d4f1194ad4ce400985c44/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:33.169474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 130/263] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:33.174236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:33.175885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:33.268009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:33.296944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b858-6e61-4635-9b7d-50fdcf69a337 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:33.335986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:33.337148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:33.337601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:33.338789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:33.340293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:33.342025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:33.344260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 134/264] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:33 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:33.350081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:33.396071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9022a9e-44f8-4bfc-8284-7f27fa3904d3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:33.416456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:33.465965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f222b2-a973-4e6c-8b4a-a8a8debd50f2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:33.491192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:33.492080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:33.492361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:33.492636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] PATH_INFO: `/v3/users/ea8cbe51d18141699c20356f72301f34` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:33.493859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8cbe51d18141699c20356f72301f34)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:33.495390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:33.497214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 131/265] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:33 2022] GET /identity/v3/users/ea8cbe51d18141699c20356f72301f34 => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:33.502453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:33.504515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:33.505394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:33.505846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:33.506319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:33.507320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=ea8cbe51d18141699c20356f72301f34) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:33.507802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:33.509475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:33.517244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 135/266] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:33 2022] GET /identity/v3/role_assignments?user.id=ea8cbe51d18141699c20356f72301f34&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:33.642850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cd6c-1ef0-437a-8d56-baf6b65b07b3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:33.659174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:33.694316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:33.694978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:33.695260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:33.695538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:33.782365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:33.783837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac9b5e-c8d8-4993-86e2-1a5dea77f6e8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:33.913397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 132/267] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:33.919439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.051122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06cfc-d638-42af-b1f3-44aa4a66850a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.051444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06cfc-d638-42af-b1f3-44aa4a66850a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.051608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d06cfc-d638-42af-b1f3-44aa4a66850a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.052998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 133/268] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:34.063782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a552-0f5e-4664-a983-6f0939d7e8c8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.064045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a552-0f5e-4664-a983-6f0939d7e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.064251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772a552-0f5e-4664-a983-6f0939d7e8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.066432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03829e8d-5f16-485e-a943-d9dd199f8f7f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.092596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.099580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8772a552-0f5e-4664-a983-6f0939d7e8c8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:34.101027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8772a552-0f5e-4664-a983-6f0939d7e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:34.106229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.117530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.118435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.118712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.118979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.120783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.122259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a12fea-04b7-490c-8ac2-1cbe5e706e39 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.124114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 136/269] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:33 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:34.126859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6045-ccf0-45cd-8d81-dc13d29597df None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.126859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6045-ccf0-45cd-8d81-dc13d29597df None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.126859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca6045-ccf0-45cd-8d81-dc13d29597df None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.127117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 137/270] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:34.127988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b213c9-5afe-4483-8f22-dbf6ac49e65a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.128267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b213c9-5afe-4483-8f22-dbf6ac49e65a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.128573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b213c9-5afe-4483-8f22-dbf6ac49e65a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.129888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 138/271] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:34.134402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b213c9-5afe-4483-8f22-dbf6ac49e65a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.183550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:34.184786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929125-a4fd-4ede-baba-8b5031a83cb3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.185073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929125-a4fd-4ede-baba-8b5031a83cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.185346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929125-a4fd-4ede-baba-8b5031a83cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.212431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b5929125-a4fd-4ede-baba-8b5031a83cb3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:34.213766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b5929125-a4fd-4ede-baba-8b5031a83cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:34.251357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b213c9-5afe-4483-8f22-dbf6ac49e65a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.289293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.289644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 135/273] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:34.290094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.290251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.290524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.292007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=ea8cbe51d18141699c20356f72301f34) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:34.292319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.292900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.293371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.293789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.294067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.301132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 139/274] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/role_assignments?user.id=ea8cbe51d18141699c20356f72301f34&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=1801c155c74646c1a128d958c3f795a4 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:34.308815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.323989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:34.325206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:34.390867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.412360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.420397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 136/275] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:34.427162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.460170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c626d00-cbcb-4317-81ec-67c937cf5078 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.504091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.504891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.505170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.505441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.524887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:34.531283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:34.532144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:34.532940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 140/276] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:34.533574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.574970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24998a8-8f2c-4b7f-b6bb-d21b0bd0ea51 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.612499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.613397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.613690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.613995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.624894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:34.632752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:34.633597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 137/277] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:34.639122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.652213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2ea59-d219-4f9f-a04e-15c2fc628bae None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.668016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.691087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.691892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.692179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.692455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.693600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.695093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.696960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 141/278] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:34.697490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.707324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.754937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b315e-1a34-4975-a53b-923eb7f68eee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.796339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.797011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.797410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.797687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.798597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:34.798911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.800414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.803707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dab36-c598-4aeb-8e37-de0e4c5f98bd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.814740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 138/279] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:34.816120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.842035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.842863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.843451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.843740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.844482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:34.844784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.846274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.855669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:34.856307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:34.904351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.927268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd018f22-a531-470a-b3db-7d586696a995 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.950856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:34.961102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff7b28-0a92-454c-a96f-f6827b3eab67 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:34.963807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:34.964469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:34.964751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:34.965022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:34.965724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:34.967205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:34.988862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 139/281] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:34 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:34.989580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:35.014252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:35.015760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.017052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.017544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] PATH_INFO: `/v3/users/ecb42811d01c42efa2d58cadcd7ef48c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.038914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] RBAC: Authorizing `identity:get_user(user_id=ecb42811d01c42efa2d58cadcd7ef48c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:35.042058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:35.044933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 143/282] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/users/ecb42811d01c42efa2d58cadcd7ef48c => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:35.051305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:35.118769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1f253-d0d2-4e3d-a8d6-c017118c3c15 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:35.168600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:35.172263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.172534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.172813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] PATH_INFO: `/v3/users/3f7a54e1a57e4f88bec65f7439540c99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.174825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7a54e1a57e4f88bec65f7439540c99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:35.176430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:35.179579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 140/283] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:34 2022] GET /identity/v3/users/3f7a54e1a57e4f88bec65f7439540c99 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:35.184892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:35.195078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a5bbd-6d0d-47c5-833b-1ada27bf316c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:35.197207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:35.236922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:35.237584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.237861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.238176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.239008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, user.id=ecb42811d01c42efa2d58cadcd7ef48c, scope.system=all) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:35.239592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:35.240743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:35.246372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 144/284] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 15:13:35 2022] GET /identity/v3/role_assignments?user.id=ecb42811d01c42efa2d58cadcd7ef48c&scope.system=all&role.id=b2d7b12184614f5997f9ce444f519150 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:35.246518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:35.322937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e862dd-3d42-474e-8cec-e9ed625974a1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:35.363862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:35.364752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.365037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.365314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.366622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:35.368186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afd8a3-5309-4bab-a244-3c8ee48d6d20 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:35.370347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 141/285] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:35 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:35.376373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:35.500178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c7bb-c51c-416b-98d5-b9801adcd001 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:35.539986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:35.541180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.541606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.542052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/3f7a54e1a57e4f88bec65f7439540c99/roles/ae7e960f125a4a18a06696bc0a7e91e2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.544225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, user_id=3f7a54e1a57e4f88bec65f7439540c99, role_id=ae7e960f125a4a18a06696bc0a7e91e2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:35.545850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed06db-ff71-483e-af76-3cf9d3e8f5b9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:35.575332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 145/286] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:13:35 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/users/3f7a54e1a57e4f88bec65f7439540c99/roles/ae7e960f125a4a18a06696bc0a7e91e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:35.806064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b92ed-a5a5-4e65-8c3d-df07c71046b2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.806449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b92ed-a5a5-4e65-8c3d-df07c71046b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.806655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b92ed-a5a5-4e65-8c3d-df07c71046b2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.808282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 142/287] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:35.814262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:35.814815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:35.815284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:35.834119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:35.835289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:35.861996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:35.914123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 146/288] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:35.938174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b92ed-a5a5-4e65-8c3d-df07c71046b2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:36.082550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b92ed-a5a5-4e65-8c3d-df07c71046b2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:36.103065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:36.131512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:36.132300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:36.132583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:36.132860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:36.150794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:36.158657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:36.159504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:36.160291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:36.167653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:36.284072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205e8bd-b6b4-4056-88a2-2e3082396a4c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:36.319022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:36.319699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:36.319980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:36.320253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:36.321003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:36.321307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:36.322745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:36.331774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 147/290] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:36.336865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:36.455918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb4b1-2b62-4458-ae45-77f9f81d8a5c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:36.503417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:36.504361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:36.504646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:36.504919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] PATH_INFO: `/v3/users/5b2f5941737d4f1194ad4ce400985c44` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:36.506196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] RBAC: Authorizing `identity:get_user(user_id=5b2f5941737d4f1194ad4ce400985c44)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:36.507748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:36.509388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 144/291] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:36 2022] GET /identity/v3/users/5b2f5941737d4f1194ad4ce400985c44 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:36.515635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:36.536146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:36.622517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fcde-7f8a-420d-a3d9-b74513466b42 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:36.658831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:36.659483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:36.659765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:36.660038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:36.731130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:36.732538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:36.751156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:36.834806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 148/292] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:36.843008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:36.921629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:36.995187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25b97-974a-4e77-894a-eb64cbe24c1a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:37.041576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:37.042468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.042754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.043033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.044233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:37.045681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22190-8c71-4943-a5c0-c31288c96df0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:37.047722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 145/293] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:36 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:37.053465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:37.183730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e2fe-a897-4d6a-86e8-a11da481f410 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:37.204028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:37.226131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:37.226794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.227076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.227407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.228246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=5b2f5941737d4f1194ad4ce400985c44) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:37.229128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:37.230604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9863ed-0faa-4006-b306-742c9d244b68 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:37.236775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 149/294] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:37 2022] GET /identity/v3/role_assignments?user.id=5b2f5941737d4f1194ad4ce400985c44&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=b2d7b12184614f5997f9ce444f519150 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:37.661853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f8e6-0b7c-4314-a5ea-b9bfa4e10c47 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.662374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f8e6-0b7c-4314-a5ea-b9bfa4e10c47 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.662709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f8e6-0b7c-4314-a5ea-b9bfa4e10c47 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.664187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 146/295] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:37.670367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.670766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.670932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.687924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:37.689135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:37.767400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 150/296] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:37.793091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775f8e6-0b7c-4314-a5ea-b9bfa4e10c47 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:37.910509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775f8e6-0b7c-4314-a5ea-b9bfa4e10c47 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:37.926038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:37.953271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd216277-f486-4726-909c-14964564a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:37.954176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd216277-f486-4726-909c-14964564a06d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.954543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd216277-f486-4726-909c-14964564a06d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.954832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd216277-f486-4726-909c-14964564a06d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.966086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd216277-f486-4726-909c-14964564a06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cd216277-f486-4726-909c-14964564a06d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:37.973839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:37.974715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:37.975485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 147/297] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:37.981265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:37.994742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf87a1-997b-4599-9022-32d1c3a6d121 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:37.995036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf87a1-997b-4599-9022-32d1c3a6d121 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:37.995294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf87a1-997b-4599-9022-32d1c3a6d121 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:37.996903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 148/298] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:38.002205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a2bb-b7fe-472b-b599-7362c8d3e71d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.002533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a2bb-b7fe-472b-b599-7362c8d3e71d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.002813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a2bb-b7fe-472b-b599-7362c8d3e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.021881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ee91a2bb-b7fe-472b-b599-7362c8d3e71d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:38.023109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ee91a2bb-b7fe-472b-b599-7362c8d3e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:38.086426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4f738-8211-4dd0-9360-2c65e69c29da None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.090194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 149/299] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:38.091287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972b0a-3a04-4532-a422-0e9244480cbc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.091578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972b0a-3a04-4532-a422-0e9244480cbc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.091855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d972b0a-3a04-4532-a422-0e9244480cbc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.093119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 150/300] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:38.097694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a8f-791f-444e-9636-75545c44d13b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.097694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a8f-791f-444e-9636-75545c44d13b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.097694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a8f-791f-444e-9636-75545c44d13b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.097694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 151/301] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:38.098694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.098978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.099256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.105762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.115830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:38.117010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:38.128459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.129127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.129410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.129682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.130453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:38.130757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.132119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f78d-1915-43b4-b21b-c22b5a098f94 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.140883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 151/302] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.142087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.142365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.142636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.158499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:38.159646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:38.188686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 152/303] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:38.189455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.222277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.232702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 152/304] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:38.233837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.293648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae145e4-0484-41df-b453-c7dd47600da0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.329314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.330139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.330418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.330701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.331869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.333318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.334050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29559dd-9598-45fe-a4c5-d3235cfb0fd2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.334968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 153/305] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.335729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.340417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.374162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.375024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.375299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.375569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] PATH_INFO: `/v3/users/a122e0c48e6648f9b0e115fc36ea66cf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.388772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] RBAC: Authorizing `identity:get_user(user_id=a122e0c48e6648f9b0e115fc36ea66cf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.390246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.392145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 153/306] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/users/a122e0c48e6648f9b0e115fc36ea66cf => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.392889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.433853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.439180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0818624-06de-415d-a829-70e5cc860dfe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.473047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.473828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.474138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.474414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.484496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:38.489011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332d50e-864c-44c3-a046-e1020423c40c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:38.492077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:38.493030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:38.493855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 154/307] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:38.495182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.524799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.525592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.525877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.526185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.536467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:38.544768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:38.545639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 154/308] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:38.551528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.576611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.596570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d13d8-13cf-4daf-9867-ef5e97df6a0b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.630669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.631334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.631623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.631892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.632603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.634086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.648477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 155/309] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Jul 6 15:13:38 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:13:38.649295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.650889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adddf5-f8f2-4908-bcfd-733242c8a053 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.672098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.694559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.695176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.695593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.695878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.696737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, user.id=a122e0c48e6648f9b0e115fc36ea66cf, scope.system=all) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:38.697052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.698636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.705130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 155/310] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/role_assignments?user.id=a122e0c48e6648f9b0e115fc36ea66cf&scope.system=all&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.706425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.805432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3cbcc-7b13-4cac-a263-0666734e68f4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.817858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:38.839916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04726f-5a5a-44c8-b675-055df1b70db6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.855630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.856686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.857041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.857322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.858705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:38.859177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.860745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.871813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 156/311] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.879958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.886099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:38.886784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:38.887068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:38.887346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:38.888105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:38.888411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:38.889793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:38.899426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 156/312] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:38.905443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:38.988440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982078-916f-4fea-8892-81c59ed70b52 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:38.990287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:39.028309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.029191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.029473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.029748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] PATH_INFO: `/v3/users/ecb42811d01c42efa2d58cadcd7ef48c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.031009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] RBAC: Authorizing `identity:get_user(user_id=ecb42811d01c42efa2d58cadcd7ef48c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.032575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.039300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 157/313] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/users/ecb42811d01c42efa2d58cadcd7ef48c => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:39.040300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:39.047943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8deef-8533-44d9-b9c5-4c686ebf3a16 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:39.084682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.085938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.086455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.086933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] PATH_INFO: `/v3/users/3f7a54e1a57e4f88bec65f7439540c99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.088432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] RBAC: Authorizing `identity:get_user(user_id=3f7a54e1a57e4f88bec65f7439540c99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.090136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.092301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 157/314] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:38 2022] GET /identity/v3/users/3f7a54e1a57e4f88bec65f7439540c99 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:39.101930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:39.122402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:39.153128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd9c4-28e4-42ac-9281-25c504089efe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:39.198961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.199815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.200097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.200373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] PATH_INFO: `/v3/system/users/ecb42811d01c42efa2d58cadcd7ef48c/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.202060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ecb42811d01c42efa2d58cadcd7ef48c, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.203707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.217158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 158/315] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Jul 6 15:13:39 2022] PUT /identity/v3/system/users/ecb42811d01c42efa2d58cadcd7ef48c/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:13:39.224792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2173d-ab38-434b-bd50-ad8de2c3003c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:39.273001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.273741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.274067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.274352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.354924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.356063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.376013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:39.465306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 158/316] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:39.470777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:39.487069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:39.577086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc7753-bb35-4d1b-8a00-0eaabd40c801 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:39.611182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.612040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.612324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.612600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.613788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.615265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd784b-8bda-4f1a-8f4d-7e8233ea3df1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.617277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 159/317] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:39 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:39.623703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:39.732694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb2e1-1bf4-45b5-8b71-7c1ae1089b7a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:39.750707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:39.769332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:39.770040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:39.770329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:39.770607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:39.771444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, scope.project.id=1706a94e0bfd4db9844794b665622ab8, user.id=3f7a54e1a57e4f88bec65f7439540c99) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:39.771756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:39.773187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff5903-eebb-48f7-9613-95727d75ea5d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:39.780285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 159/318] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:13:39 2022] GET /identity/v3/role_assignments?user.id=3f7a54e1a57e4f88bec65f7439540c99&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:40.724414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c8c-bfef-4038-a3c2-f66269fc2d9f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:40.724954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c8c-bfef-4038-a3c2-f66269fc2d9f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:40.724954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c8c-bfef-4038-a3c2-f66269fc2d9f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:40.726521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 160/319] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:40.732042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dcc34-d9d2-43d6-8775-b030be3b89b1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:40.732551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dcc34-d9d2-43d6-8775-b030be3b89b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:40.733032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dcc34-d9d2-43d6-8775-b030be3b89b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:40.750022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-de1dcc34-d9d2-43d6-8775-b030be3b89b1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:40.751191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-de1dcc34-d9d2-43d6-8775-b030be3b89b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:40.815369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 160/320] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:40.837766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21c8c-bfef-4038-a3c2-f66269fc2d9f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:40.861621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438635-8494-4c1b-9dbd-89bd541e0214 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:40.861963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438635-8494-4c1b-9dbd-89bd541e0214 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:40.862248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438635-8494-4c1b-9dbd-89bd541e0214 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:40.863640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 161/321] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:40.868806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:40.869156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:40.869456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:40.886577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:40.887767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:40.924412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:40.948355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21c8c-bfef-4038-a3c2-f66269fc2d9f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:40.961815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 162/322] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:40.983354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:40.984063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:40.984228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:40.984342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:40.984593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:40.985744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:40.987216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:40.988836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 161/323] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:40.994178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.028902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.088615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca810d1f-465f-48cd-853a-e420440822f9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.104419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796220-ed92-4bc9-8875-966ad6ce4266 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.124783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.125579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.125865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.126170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.136868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:41.142186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.143051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.143502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.143955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:41.144779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:41.145611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:41.146413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 163/324] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:41.147049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:41.147710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb9352-7db7-40e7-a566-ddce1e4b5371 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:41.152454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.169976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 162/325] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Jul 6 15:13:40 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:13:41.272107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.276173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e02552-87f0-491e-b7a8-3c122bfffadb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.308742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb989-78ee-4600-bf90-b9b5237ad071 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.309139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb989-78ee-4600-bf90-b9b5237ad071 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.309572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cb989-78ee-4600-bf90-b9b5237ad071 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.311457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 163/326] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:41.316773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.317064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.317343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.327666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.328611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.329068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.329344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.330182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:41.330483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:41.331891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:41.336261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:41.337449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:41.340354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.341169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 164/327] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:41.347330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.427584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 164/328] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:41.452140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.479467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36211e-bb35-439f-963c-c636975bdd72 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.521071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.521975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.522308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.522529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] PATH_INFO: `/v3/users/a122e0c48e6648f9b0e115fc36ea66cf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.523958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] RBAC: Authorizing `identity:get_user(user_id=a122e0c48e6648f9b0e115fc36ea66cf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:41.525512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:41.527695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 165/329] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:41 2022] GET /identity/v3/users/a122e0c48e6648f9b0e115fc36ea66cf => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:41.532789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.573799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.574009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa12d04-d58e-42e2-9196-ee2464714870 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.615684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.616598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.616877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.617150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.627490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.631894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:41.641871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:41.643072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:41.644116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 165/330] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:41.649285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.662109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8edacc-b20a-4294-85b5-a9adac145852 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.710137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.711661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.712091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.712514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] PATH_INFO: `/v3/system/users/a122e0c48e6648f9b0e115fc36ea66cf/roles/ae7e960f125a4a18a06696bc0a7e91e2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.714585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a122e0c48e6648f9b0e115fc36ea66cf, role_id=ae7e960f125a4a18a06696bc0a7e91e2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:41.717387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:41.730518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 166/331] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Jul 6 15:13:41 2022] PUT /identity/v3/system/users/a122e0c48e6648f9b0e115fc36ea66cf/roles/ae7e960f125a4a18a06696bc0a7e91e2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:13:41.782267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6c5e-0054-4691-8ee5-1a9b0f3b3dd8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:41.825365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:41.826475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:41.826982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:41.827491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:41.828557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:41.829082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:41.830812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:41.841421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 166/332] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:41.846739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:41.962548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:41.970944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d602ff-32fe-4e96-9bb9-e17a93c90808 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:42.009320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:42.010895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:42.011176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:42.011443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] PATH_INFO: `/v3/users/ecb42811d01c42efa2d58cadcd7ef48c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:42.012688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] RBAC: Authorizing `identity:get_user(user_id=ecb42811d01c42efa2d58cadcd7ef48c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:42.014178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aee230-d54b-466e-9b6a-1bf5c87f9b5d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:42.016327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 167/333] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:41 2022] GET /identity/v3/users/ecb42811d01c42efa2d58cadcd7ef48c => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:42.021927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:42.086214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:42.136724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e35bf0-4920-40a3-99c7-60a9337de947 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:42.179910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:42.180560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:42.180839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:42.181106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:42.182579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] RBAC: Adding query filter params (role.id=b2d7b12184614f5997f9ce444f519150, user.id=ecb42811d01c42efa2d58cadcd7ef48c, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:42.182887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:42.184338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559ddf-6304-4fa3-b54e-86e0f761daa8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:42.201811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 167/334] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 15:13:42 2022] GET /identity/v3/role_assignments?user.id=ecb42811d01c42efa2d58cadcd7ef48c&scope.system=all&role.id=b2d7b12184614f5997f9ce444f519150 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:43.688346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108c17-6033-40a8-88ee-8c1fa5eb33d3 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:43.688842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108c17-6033-40a8-88ee-8c1fa5eb33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:43.688842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108c17-6033-40a8-88ee-8c1fa5eb33d3 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:43.690478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 168/335] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:43.703828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:43.704294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:43.704367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:43.726889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:43.728058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:43.804495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 168/336] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:43.836732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9108c17-6033-40a8-88ee-8c1fa5eb33d3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:43.968815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9108c17-6033-40a8-88ee-8c1fa5eb33d3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:44.013627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:44.014490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.014774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.015054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.031345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:44.039764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:44.040671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:44.041507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:44.042797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 169/337] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:44.047250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:44.127453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.190488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194cbcc-6fd5-4619-abc7-94e35f2a27ca None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:44.236092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:44.236677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.236956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.237227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.238006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:44.238312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:44.239684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81da843-48ff-4006-b23e-c676e219569a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:44.253515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 169/338] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:44.258731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:44.278914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48364a9-7549-4cd6-b7cb-610c1a87b555 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.279207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48364a9-7549-4cd6-b7cb-610c1a87b555 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.279460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48364a9-7549-4cd6-b7cb-610c1a87b555 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.281074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 170/339] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:44.286133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.286417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.286694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.296845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.305512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:44.314140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:44.399694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 171/340] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:44.442978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:44.482863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526195b3-cad5-499b-a31a-4c34284720da None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:44.533447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.534448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:44.535098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.535637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.538051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.617307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19195-e73f-4ab9-a9f4-428fa9748974 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:44.622775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:44.624506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dbe4d-601a-4604-9253-b0143d98ed6b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:44.653304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.656155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:44.657060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.657192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.657634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.669271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b3de153b-1fd0-48cf-a569-dac796272d4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:44.677141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:44.678222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 15:13:44.679241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:44.682267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 172/341] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:44.683688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ec09-ae1b-4deb-af23-bfdff43c7b56 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.684104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ec09-ae1b-4deb-af23-bfdff43c7b56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.684566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5ec09-ae1b-4deb-af23-bfdff43c7b56 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.686000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 173/342] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:44.687352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93904a2-10c3-498f-ac8d-f1c7f78179e6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.687813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93904a2-10c3-498f-ac8d-f1c7f78179e6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.688262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93904a2-10c3-498f-ac8d-f1c7f78179e6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.689740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 174/343] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:44.691149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.691609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.692072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.720488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:44.721682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:44.767945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 170/344] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:44.770035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:44.770501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:44.770953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:44.792354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:44.794614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:44.807648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 175/345] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 06 15:13:44.808876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:44.860383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.878654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 171/346] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:44.879760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:44.941868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:44.967314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51b7c-962f-4b99-8ce4-2a84cad93403 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:44.992361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bebaf4-3fcc-4b57-bc27-fcb5506769eb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.005645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.006358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.006781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.007184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.008163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:45.008673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.011312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.021757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 176/347] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.022718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.034180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.035423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.035887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.036357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.037881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.039602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.043634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 172/348] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:44 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.044821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.134399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.147287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04359-c810-4db1-9e42-eaf904de7e51 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.156873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f98cdb-983a-418b-99aa-fc44b5237c0b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.180473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.193054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.194343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.194343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.194646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.196818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.197998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.198497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.199003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.209570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:45.214258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:45.219089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:45.220055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 177/349] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:45.221239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:45.225497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:45.226393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:45.227163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:45.234020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 173/350] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:45.235173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.359197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2c49-e5b6-4e13-a1ff-9b0aa7c97c2e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.359718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b41f0c-eb06-45d1-8529-57a4443ae3e4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.399103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.400875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.401362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.401872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.403320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.404190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.404473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.404912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] PATH_INFO: `/v3/users/a122e0c48e6648f9b0e115fc36ea66cf` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.406187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a122e0c48e6648f9b0e115fc36ea66cf)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.408008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.409711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.410410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 178/351] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/users/a122e0c48e6648f9b0e115fc36ea66cf => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.411186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.412169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.414451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 174/352] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.415494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.437380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.471263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.533744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9b6e0-6ebf-4ff7-9724-4a00f2a3409f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.544841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d1216-ccf4-422c-9dda-33c14455f8b6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.575051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.576208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.576738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.577208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.578201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:45.578707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.580305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.586494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.587186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.588959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.588959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.589214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:45.589499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.591083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.594053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 175/353] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.595171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.599898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 179/354] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.600725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.709013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.724268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf66c-f991-4f14-b879-ad5cb0560f00 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.734287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:45.735753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b28a9-84c3-4404-a0c5-fc420ee10e98 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:45.781815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.781815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.781815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.781815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.782749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] RBAC: Adding query filter params (role.id=ae7e960f125a4a18a06696bc0a7e91e2, user.id=a122e0c48e6648f9b0e115fc36ea66cf, scope.system=all) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:45.784181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.785608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.789006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:45.789664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:45.792402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:45.792402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:45.792402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=8107613fb0b446c89653731516ee4f99) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:45.792402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:45.792872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:45.799370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 180/355] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=1801c155c74646c1a128d958c3f795a4 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.800188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.801071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 176/356] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/role_assignments?user.id=a122e0c48e6648f9b0e115fc36ea66cf&scope.system=all&role.id=ae7e960f125a4a18a06696bc0a7e91e2 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:45.802252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:45.984287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3479-b645-424e-986c-bdda1c689c86 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.027602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9d740-6e96-4b7a-b766-35a12f79f275 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.052676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.053344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.053630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.053928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.079413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.080410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.080969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.081456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.094705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.102469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.140920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:46.142467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a4df-d041-4da8-babc-6f47e09ea737 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:46.175508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:46.177068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18895b8-9b9b-452a-8eac-90b42f371375 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:46.271230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 177/357] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977154e-d9a2-4477-bf4f-9bb22ccc615d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977154e-d9a2-4477-bf4f-9bb22ccc615d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977154e-d9a2-4477-bf4f-9bb22ccc615d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 178/358] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ca41-e9f4-486c-83fb-ea1358943906 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.276926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ca41-e9f4-486c-83fb-ea1358943906 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.277438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39ca41-e9f4-486c-83fb-ea1358943906 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.278623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 179/359] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:46.279391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ca41-e9f4-486c-83fb-ea1358943906 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.313949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 181/360] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:46.313949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706390b-9c31-4e23-b03e-8a4bada7966c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.313949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706390b-9c31-4e23-b03e-8a4bada7966c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.314202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706390b-9c31-4e23-b03e-8a4bada7966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.337519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6706390b-9c31-4e23-b03e-8a4bada7966c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:46.338821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6706390b-9c31-4e23-b03e-8a4bada7966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:46.362881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.391176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.412439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39ca41-e9f4-486c-83fb-ea1358943906 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.419567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 182/361] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:46.420851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.422163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.422467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.449927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:46.450122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.450859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.451138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.451383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:46.451485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.452683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:46.454275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:46.456128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 180/362] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:46.456875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.529539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 183/363] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:46.530329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.592244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a36ac-ba1c-426d-9a26-dcf0af6bb187 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.627872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.638412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.642403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.642403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.642403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.642403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:46.644144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:46.645824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 181/364] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:46.646580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.653011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d77c6-cbbf-477e-9e40-059a6d372835 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.664426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.703495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.704297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.704575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.704844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.717272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:46.724853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:46.725722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:46.727351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:46.732494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 184/365] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:46.732710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.779958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d0fd-a237-4bf6-8617-6b6bb3135b29 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.824438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.825305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.825588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.825863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.827075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:46.828531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:46.830482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 182/366] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:46.832192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.862643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081d38-b15e-4cce-bdc8-1d0c82db53d2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:46.906575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:46.907392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:46.907676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:46.907955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:46.920885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:46.929011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:46.930170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:46.931166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:46.937037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 185/367] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:46.937037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:46.944429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.964688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:46.988548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95851-4bda-4833-ad39-35d5733d76de None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.042801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.044359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.044359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.044550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.045795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.047545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.049747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 183/368] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.050742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.059965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb8dc-1fe6-4804-a758-636bc2cb75fa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.103297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.103937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.104219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.104493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.105241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:47.105857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.106968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.115844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 186/369] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.116753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.191786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86250b-37ae-40d2-8bd9-1a35a6010c83 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.234938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:47.245333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.246047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.246341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.246644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.247607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=8107613fb0b446c89653731516ee4f99) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:47.247918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.250313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.253670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:47.257767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d94ff-c5bc-45f8-988a-4af31c11d8f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.257919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 184/370] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=b2d7b12184614f5997f9ce444f519150 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.266284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.299052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.300189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.300837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.301369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.303028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:47.303679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.305421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.317107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 187/371] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.323361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.410683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8e1a0-d1db-4b7d-8a17-91e20a6b09b3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.454957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790850-6603-49fd-bf82-6d21839aaac2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.462272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.463855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.464365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.464646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.465510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=1706a94e0bfd4db9844794b665622ab8) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:47.465815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.467855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.476661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 185/372] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=b2d7b12184614f5997f9ce444f519150 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.477470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.496425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.497205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.497488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.497789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.525428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:47.594874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.596294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.601210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:47.685111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7dd6-8581-4019-b399-a413adea319f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.709542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:47.716291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.748630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.749302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.751812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.751812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.782730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:47.835955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859b48-aa99-48be-a8de-1529ccd01ae6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:47.859638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.860822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.888135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:47.889708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:47.891108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:47.891769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] PATH_INFO: `/v3/projects/384fdc49fff9422ba6ec721becb44e7d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:47.894060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=384fdc49fff9422ba6ec721becb44e7d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:47.896746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:47.898909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/projects/384fdc49fff9422ba6ec721becb44e7d => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:47.904868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:47.962581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.043239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 186/375] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:48.048406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.102289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2acc-a06d-453f-bbd7-d1088bb69fd9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.126422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.143186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.144043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.144325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.144598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] PATH_INFO: `/v3/groups/8ea44772247c4f3a891c3433866c035b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.153949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea44772247c4f3a891c3433866c035b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.155424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140359f-3c8b-42d6-aa39-595457b56857 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.157426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 190/376] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:47 2022] GET /identity/v3/groups/8ea44772247c4f3a891c3433866c035b => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:48.158958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1510-1522-4c68-b17f-857d7fa0a53b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.159241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1510-1522-4c68-b17f-857d7fa0a53b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.159520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed1510-1522-4c68-b17f-857d7fa0a53b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.160746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 191/377] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:48.169118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed1510-1522-4c68-b17f-857d7fa0a53b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.196624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b746905-97b8-4d1b-9ed7-74f89f4ec8ff None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.238400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.240301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.241040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.241519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.243793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.246138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c6dd2-79fc-4897-bc19-ac9693ac13fc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.252916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 187/378] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:48.254007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.254311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.254578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.275042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:48.277972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:48.299740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed1510-1522-4c68-b17f-857d7fa0a53b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.321130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.343771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.344922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.345407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.345772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.346728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] RBAC: Adding query filter params (group.id=8ea44772247c4f3a891c3433866c035b, role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=384fdc49fff9422ba6ec721becb44e7d) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:48.347135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.348913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.357226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 192/379] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/role_assignments?group.id=8ea44772247c4f3a891c3433866c035b&scope.project.id=384fdc49fff9422ba6ec721becb44e7d&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:48.358160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.373430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 188/380] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:48.405164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.418340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.495243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adff213-2a06-4130-859e-15b8b218531d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.547272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.548547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.549316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.550064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.551656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c4e7-4c66-46f4-aa97-7c5328a08e19 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.552187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.554831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.557084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 193/381] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:48.562515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.622236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.622845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.623132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.624275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.642717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:48.652185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:48.653257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:48.654238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:48.656645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 189/382] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:48.662634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:48.703644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.714949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cbce-362c-46ba-ac00-7dc92d2d0f64 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.731349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:48.755175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.756070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.756522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.757335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.758630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=1706a94e0bfd4db9844794b665622ab8) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:48.759090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.761709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.769295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 194/383] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=1801c155c74646c1a128d958c3f795a4 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:48.793393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052bc1-16e4-4b8c-a270-5cf826c6c783 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:48.850562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:48.851265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:48.851548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:48.851882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:48.852656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:48.852962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:48.854446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:48.868799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 190/384] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:48.875193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:49.005178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0486-cff2-41f6-a9c6-153a02746923 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:49.043347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:49.044203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:49.044482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:49.044752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:49.045949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:49.047412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:49.049032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 195/385] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:48 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:49.054685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:49.141833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:49.160148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3383b3-83b0-42c1-8cd7-96a72d7e173e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:49.207254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:49.208141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:49.208421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:49.208694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:49.209930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:49.211379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8baa2-1cf7-4ca4-8a23-15dfbf374590 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:49.213395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 191/386] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:49 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:49.218843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:49.294643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:49.365698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b665f-4f63-48a9-9aa2-5b558d29ab9c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:49.408515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:49.409400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:49.409681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:49.409979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:49.415782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, group_id=9e54cdd81193470d920ba6f0ab9d4b83, role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:49.417786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef205b7-55d9-426a-b08b-203b4aada9cc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:49.456385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 196/387] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 15:13:49 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/1801c155c74646c1a128d958c3f795a4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:49.867131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb163-f2c9-4703-b3b6-44d9f9d7dbb6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:49.867835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb163-f2c9-4703-b3b6-44d9f9d7dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:49.868339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb163-f2c9-4703-b3b6-44d9f9d7dbb6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:49.870508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 192/388] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:49.876368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278af2-23d6-4311-a2ed-495d1a7c803a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:49.876898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278af2-23d6-4311-a2ed-495d1a7c803a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:49.877372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278af2-23d6-4311-a2ed-495d1a7c803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:49.897255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cb278af2-23d6-4311-a2ed-495d1a7c803a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:49.898799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cb278af2-23d6-4311-a2ed-495d1a7c803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:49.988323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 197/389] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:50.016727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fb163-f2c9-4703-b3b6-44d9f9d7dbb6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.149330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23eb25-a980-4b5f-a1db-eec82a1c318a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.149816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23eb25-a980-4b5f-a1db-eec82a1c318a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.149816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23eb25-a980-4b5f-a1db-eec82a1c318a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.151740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 198/390] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:50.156698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.157192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.157666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.161054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fb163-f2c9-4703-b3b6-44d9f9d7dbb6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.189723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:50.190954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:50.224539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.225340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.225618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.225888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.249847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:50.250481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:50.258452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:50.259400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:50.260747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:50.261994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 193/391] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:50.270002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.294446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:50.347474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 199/392] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:50.381603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.452627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322657e-8fb5-44f2-947e-8eee4b1c967f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.494819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de290e-5cb9-4d03-91c2-76a98cad7853 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.520129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.526710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.526987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.527271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.528029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:50.528339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:50.529739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:50.539529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.540600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.541673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.542179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.549456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 194/393] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:50.552164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.564102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:50.573772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:50.574707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:50.575535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:50.578737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 200/394] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:13:50.588667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.652155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:50.659158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:50.682604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22232-599b-4c34-b8f4-1eff8b489ccb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.729873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.730673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.730950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.731218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.732388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:50.734229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:50.735740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 195/395] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:50.747040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.775079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855834e-dafc-43bd-8a87-9cf8f03fab12 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.823803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.824800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.825271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.825728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.826671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:50.827177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:50.828750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:50.846253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 201/396] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:50.861279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eac2-b9b5-4f40-a157-037dc14fa83d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:50.863372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.905360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:50.906281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:50.906520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:50.906790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:50.907982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:50.909416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:50.915723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 196/397] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:50.927365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:50.954320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:50.976825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.001738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a17cce-71cf-46db-b3bb-70af1a94b8af None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.063227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9e266-75fe-45a5-84be-837abf301878 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.066255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.067181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.067464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.067738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.071497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.073605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:51.075660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 202/398] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:50 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:51.082163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.118616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.120140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.120423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.120691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.127306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8107613fb0b446c89653731516ee4f99, group_id=9e54cdd81193470d920ba6f0ab9d4b83, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.128745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:51.165021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 197/399] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 15:13:50 2022] PUT /identity/v3/projects/8107613fb0b446c89653731516ee4f99/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:13:51.211201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692ebc-a548-42e6-8291-55ce8af17b42 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.262944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.263718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.263997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.264269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.270803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.272386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191829d-9a72-4257-ac1d-3f2805fda285 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:51.274204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 203/400] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:51.279947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.311031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4eeb9-0c9f-43fd-8d4b-713e4bcbd4b2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.311314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4eeb9-0c9f-43fd-8d4b-713e4bcbd4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.311586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4eeb9-0c9f-43fd-8d4b-713e4bcbd4b2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.313275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 204/401] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:51.318976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3825a-1e76-456a-8530-a5d4af05b680 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.319277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3825a-1e76-456a-8530-a5d4af05b680 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.319542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3825a-1e76-456a-8530-a5d4af05b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.337226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6bf3825a-1e76-456a-8530-a5d4af05b680 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:51.338518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6bf3825a-1e76-456a-8530-a5d4af05b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:51.358681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.388569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.417637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 205/402] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:51.419194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c1b5-b96b-4f9c-b34c-33f7549ddb02 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.419482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c1b5-b96b-4f9c-b34c-33f7549ddb02 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.419758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c1b5-b96b-4f9c-b34c-33f7549ddb02 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.421254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 206/403] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:51.426892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.427177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.427455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.436183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a34b4-e86e-4162-b1bc-78480ceb73fe None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.447137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:51.448017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:51.477699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.480307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.480307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.480307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.482827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, group_id=9e54cdd81193470d920ba6f0ab9d4b83, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.484943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:51.500594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 198/404] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 15:13:51 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:51.501582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.528221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 207/405] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:51.551884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.647981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.663051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f301-a7fb-4aee-9996-e688000a9e63 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.696503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8638f-aa48-4c6c-a36b-eabe69eed32f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.701710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.702771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.703281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.703753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.716542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:51.724822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:51.725853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:51.726668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:51.735052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 208/406] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:51.736351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.774258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.783486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.784233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.784510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.784783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.807293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:51.817857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:51.818751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:51.819525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:51.820824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 199/407] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:51.826220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.855762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376ea83-21a4-493b-81b2-5c199176c12d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.892714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.893660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.894801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.895238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.896139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:51.896600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.898163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:51.907786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 209/408] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:51.913272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:51.927144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:51.952665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84376f-f18d-4dc4-9997-118f8ce24cfc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:51.994217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:51.995175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:51.995462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:51.995738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:51.996590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:51.996900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:51.998302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.011497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 200/409] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:52.017237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.039212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08508258-769c-4af9-9b6a-1f23a4a5a513 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.075109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.076191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:52.076596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.077063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.077522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] PATH_INFO: `/v3/groups/8ea44772247c4f3a891c3433866c035b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.078990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea44772247c4f3a891c3433866c035b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.080636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.082791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 210/410] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:51 2022] GET /identity/v3/groups/8ea44772247c4f3a891c3433866c035b => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:52.094896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.133499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878dc37-b62f-4490-9619-d078e0bf6905 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.204762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.206380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.206663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.206937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.208729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.210204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.218866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 201/411] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:52 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:52.220111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.242233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:52.283345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922db78-86a2-449a-b94e-d9305b39fec4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.337617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.339468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.340342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.341101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] PATH_INFO: `/v3/projects/384fdc49fff9422ba6ec721becb44e7d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.342811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] RBAC: Authorizing `identity:get_project(project_id=384fdc49fff9422ba6ec721becb44e7d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.345260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12874557-27d3-4942-ba18-5ac39350026d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.348245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 211/412] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:52 2022] GET /identity/v3/projects/384fdc49fff9422ba6ec721becb44e7d => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:52.350305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62296-010d-4264-b7fc-6e3ab8310918 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.350890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62296-010d-4264-b7fc-6e3ab8310918 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.351364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f62296-010d-4264-b7fc-6e3ab8310918 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.353077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 212/413] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:52.356526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f62296-010d-4264-b7fc-6e3ab8310918 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.370591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c9d6-e7e1-4e32-9697-aa6c0992d0d3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.393199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:52.410457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.411730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.411730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.411910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.413044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.414538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d2b97-16ac-4cf2-af82-831d2fd034c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.420927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 202/414] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:52 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:52.420927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.420927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.420927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.437854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:52.439082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:52.506603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f62296-010d-4264-b7fc-6e3ab8310918 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.518333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 203/415] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:52.520082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.549299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.550848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.551350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.551828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] PATH_INFO: `/v3/projects/384fdc49fff9422ba6ec721becb44e7d/groups/8ea44772247c4f3a891c3433866c035b/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.554312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] RBAC: Authorizing `identity:create_grant(project_id=384fdc49fff9422ba6ec721becb44e7d, group_id=8ea44772247c4f3a891c3433866c035b, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.557175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.575934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 213/416] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 15:13:52 2022] PUT /identity/v3/projects/384fdc49fff9422ba6ec721becb44e7d/groups/8ea44772247c4f3a891c3433866c035b/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:52.582655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.582655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:52.715194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941645f-8351-4b9f-af32-996ebb5abda4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.741210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:52.762891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.763799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.764071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.764346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.770750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] RBAC: Authorizing `identity:create_grant(project_id=1706a94e0bfd4db9844794b665622ab8, group_id=9e54cdd81193470d920ba6f0ab9d4b83, role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:52.772220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:52.792104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 204/417] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 15:13:52 2022] PUT /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8/groups/9e54cdd81193470d920ba6f0ab9d4b83/roles/1801c155c74646c1a128d958c3f795a4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:13:52.797014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e7f5-22f8-4f5c-b67d-da6428ae73ce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:52.838792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:52.839933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:52.840451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:52.840923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:52.854659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:52.863503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:52.864448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:52.865224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:52.867940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 214/418] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:52.875046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:52.992308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe955-50b7-4bd2-b2cd-467f27ecb06a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:53.032804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:53.033842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.034380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.034886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.035825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:53.036328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:53.037916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:53.047853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 205/419] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:53.052960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:53.119726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:53.160689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710455d-ccaa-4347-a540-f69f2a48e1b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:53.197644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:53.198740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.199232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.199716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.268320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:53.270600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddb6ad-fe4c-443d-a093-8208a65d5c1d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:53.362433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:53.395551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 215/420] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:53.403183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:53.466273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:53.518951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133179f-b9d3-4fcb-8db2-efa8dccf398c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.519599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133179f-b9d3-4fcb-8db2-efa8dccf398c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.520071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133179f-b9d3-4fcb-8db2-efa8dccf398c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.521665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 216/421] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:53.531682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.532428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.532922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.563436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:53.564602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:53.576932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab642c-30ef-4dbf-819f-d6910ad8b8b9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:53.642126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 217/422] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:53.661553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:53.674653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:53.675525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.675808 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.677855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.679109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:53.680560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:53.684100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 206/423] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:53.689528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:53.780739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204fd14-d946-4f69-aeb7-591baf28d73e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:53.802304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:53.835763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:53.836576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.836863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.837144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.866788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd411f-b0fe-4000-a8ea-edadd60cc726 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:53.867000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:53.879249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:53.880118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:53.880887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 218/424] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:53.885920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:53.895236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:53.907586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:53.908453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:53.908788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:53.909065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:53.910332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:53.911876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:53.913807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 207/425] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:53.919626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.025041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99738-83fb-44ca-9b8e-ba6daa18bc27 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.060369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.061031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.061314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.061591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.062455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=8107613fb0b446c89653731516ee4f99) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:54.062769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.064308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443b5e3-b059-4f0a-9c59-13493992751e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.071085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 208/426] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=1801c155c74646c1a128d958c3f795a4 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:54.083812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb3014-727e-4c97-aeda-40c5a57cb0d4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.084137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb3014-727e-4c97-aeda-40c5a57cb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.084373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb3014-727e-4c97-aeda-40c5a57cb0d4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.087115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 209/427] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:54.095533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.095837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.096074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.115537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb191f21-4e59-4f48-8f9c-a57834857e8f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.129322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:54.131383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:54.195058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.195655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.195938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.196211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.197064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:54.197887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.199324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.224479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 219/428] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:54.229065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.230718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.252784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.268013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 210/429] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:54.291606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.348144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c0903-d23b-424c-817d-da252f6058cc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.389081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.389837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.390168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.390701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.419717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91685-97bd-4f03-bfa8-3054a9355a41 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.463648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.464497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.464784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.465056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.471945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.473697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.478197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:54.486011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:54.486888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:54.487657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 211/430] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:54.489799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.493334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.578239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.582487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 220/431] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:54.588880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.602039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32fdf1-0a53-4d1e-86b3-e372ad3a2163 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.638649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.639689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.640172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.640926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.641983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:54.642512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.644093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.654267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 212/432] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:54.659283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.692525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a837-ed4f-47a9-8bb4-de841222e2c1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.709008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.732671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.733442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.733718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.734030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] PATH_INFO: `/v3/projects/8107613fb0b446c89653731516ee4f99` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.735271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] RBAC: Authorizing `identity:get_project(project_id=8107613fb0b446c89653731516ee4f99)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.736828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.743103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 221/433] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/projects/8107613fb0b446c89653731516ee4f99 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:54.745842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.786795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:54.798816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addd446-1def-4663-9005-a85a29f3acf6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.843138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.844195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.844484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.844765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.867591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d19cf-a955-49ea-8f0e-ab7d9a4d06ad None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:54.905625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:54.906511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:54.906789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:54.907062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:54.908492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.909869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.917021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 222/434] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:54.918841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:54.924982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:54.926487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:54.982083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.045361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.047551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7754-6042-4359-9ba8-0c2e7fcfba0c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.062037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 213/435] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:55.064690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.092164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.092816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.093097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.093367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.094325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=8107613fb0b446c89653731516ee4f99) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:55.094633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.096162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3585b-27b7-4120-ba02-dba7c63b7418 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:55.108453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 223/436] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:54 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=8107613fb0b446c89653731516ee4f99&role.id=b2d7b12184614f5997f9ce444f519150 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:55.164427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379252-0fe0-4096-865d-b5e4ad64f7a6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.164762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379252-0fe0-4096-865d-b5e4ad64f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.164986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379252-0fe0-4096-865d-b5e4ad64f7a6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.166752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 224/437] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:13:55.172563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894cb4-ddf3-4c6a-88a9-1b71eb190811 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.172880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894cb4-ddf3-4c6a-88a9-1b71eb190811 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.173112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894cb4-ddf3-4c6a-88a9-1b71eb190811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.180893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610fbfc-d52b-4457-bea2-c551c23a6f09 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.194294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f1894cb4-ddf3-4c6a-88a9-1b71eb190811 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:55.195545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1894cb4-ddf3-4c6a-88a9-1b71eb190811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:55.220431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.221686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.222225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.222720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.224171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.225846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:55.228068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 214/438] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:55.237308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.282428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 225/439] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:13:55.307323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.310393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a710-ae06-45d5-8b45-b95cc621ed77 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.310682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a710-ae06-45d5-8b45-b95cc621ed77 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.310952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a710-ae06-45d5-8b45-b95cc621ed77 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.312677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 226/440] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:55.313053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883a710-ae06-45d5-8b45-b95cc621ed77 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.360701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dd5b7-433d-4027-b3e1-05f9e337b8a7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.372428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.403148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.404096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.404286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.404554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.405729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.407205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec01018-bea8-434c-9ea8-5aef9779439e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:55.409709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 215/441] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:55.410952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.411238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.411510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.431019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:55.433004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:55.444878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883a710-ae06-45d5-8b45-b95cc621ed77 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.487624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.488417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.488698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.488965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.502461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:55.505547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 216/442] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:55.506525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:55.510788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:55.511662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:13:55.512489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:55.518455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 227/443] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:55.518736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.584428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.636485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986a93-0a44-4b3c-9ec9-1f3230dbb59a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.649381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9afc53-ff2d-4e12-833a-e1f6661ffdc8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.652625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.674704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.675358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.675633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.675906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.676730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=b2d7b12184614f5997f9ce444f519150, scope.project.id=1706a94e0bfd4db9844794b665622ab8) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:55.677035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.678567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:55.684742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 217/444] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=b2d7b12184614f5997f9ce444f519150 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:55.685499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.692121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.692815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.693101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.693379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.694823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:55.695142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.697588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:55.707449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 228/445] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:55.713430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.799547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f035-9716-448a-be17-4abe1cb552b2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.824273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.833375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54062b1a-57d1-47d7-82e7-43d08de5fd02 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:55.840520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.841973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.842256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.842525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.858996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:13:55.867006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:55.867870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:13:55.868645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:55.869811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 218/446] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:55.875500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:55.877705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:55.878409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:55.878819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:55.879096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:55.918707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:55.957033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:55.958656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.000194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f77c2-8cf1-487c-b543-97d6030ae4cf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.042094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.042767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.043046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.043320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.044062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:56.044366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.045742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.053844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 219/447] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:56.060031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.070524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 229/448] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:13:56.076175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.105162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.139375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.160755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a41c2c-efdc-43ca-85ee-0d50a2745318 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.174930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c881a-6322-491b-92a8-0c43fa74113b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.194165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.195224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.195507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.195929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.208259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.209094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.209369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.209639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] PATH_INFO: `/v3/projects/384fdc49fff9422ba6ec721becb44e7d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.210827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] RBAC: Authorizing `identity:get_project(project_id=384fdc49fff9422ba6ec721becb44e7d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.212252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.213956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 230/449] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/projects/384fdc49fff9422ba6ec721becb44e7d => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:56.219245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.262838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.264278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.309462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.318434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a167a-2d38-46a8-b254-596cdcddfd2e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.351935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.352771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.353055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.353326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] PATH_INFO: `/v3/groups/8ea44772247c4f3a891c3433866c035b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.354513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] RBAC: Authorizing `identity:get_group(group_id=8ea44772247c4f3a891c3433866c035b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.355999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.357540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 231/450] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/groups/8ea44772247c4f3a891c3433866c035b => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:56.363155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.363270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 220/451] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 15:13:56.365628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.369442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.460758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d16e5c-f33a-4063-8b8f-4f022bb8408c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.469786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca75d-fac4-4bd0-a089-d5bff0571257 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.494475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.495117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.495394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.495659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.496479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] RBAC: Adding query filter params (group.id=8ea44772247c4f3a891c3433866c035b, role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=384fdc49fff9422ba6ec721becb44e7d) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:56.496780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.498249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.504091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 232/452] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/role_assignments?group.id=8ea44772247c4f3a891c3433866c035b&scope.project.id=384fdc49fff9422ba6ec721becb44e7d&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:56.504322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.505229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.505515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.505784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] PATH_INFO: `/v3/projects/1706a94e0bfd4db9844794b665622ab8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.506995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] RBAC: Authorizing `identity:get_project(project_id=1706a94e0bfd4db9844794b665622ab8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.508443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.510868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 221/453] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/projects/1706a94e0bfd4db9844794b665622ab8 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:56.516960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.585547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.623045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f763-ed98-4ba9-9f54-91ab0216e236 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.656959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.657816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.658127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.658400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] PATH_INFO: `/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.659573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] RBAC: Authorizing `identity:get_group(group_id=9e54cdd81193470d920ba6f0ab9d4b83)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.661014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb2e3-2884-4f0d-98ca-da839e5018b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.662652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 233/454] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/groups/9e54cdd81193470d920ba6f0ab9d4b83 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:56.669006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:56.684998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:56.768283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a29242-811c-472c-b4ca-91c4a4112a0a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:56.800860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:56.801505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:56.801784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:56.802080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:56.802926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] RBAC: Adding query filter params (group.id=9e54cdd81193470d920ba6f0ab9d4b83, role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=1706a94e0bfd4db9844794b665622ab8) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:56.803234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:56.804646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94da140-5cc0-40b4-9a87-9ee8e387050a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:56.810931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 222/455] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 15:13:56 2022] GET /identity/v3/role_assignments?group.id=9e54cdd81193470d920ba6f0ab9d4b83&scope.project.id=1706a94e0bfd4db9844794b665622ab8&role.id=1801c155c74646c1a128d958c3f795a4 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:13:59.294655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d105f1-e3ce-4439-8531-d828e34ab984 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.295193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d105f1-e3ce-4439-8531-d828e34ab984 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.295193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d105f1-e3ce-4439-8531-d828e34ab984 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.296823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 234/456] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:59.302392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447808-5d6c-4afa-8afb-971694331178 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.302392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447808-5d6c-4afa-8afb-971694331178 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.302392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447808-5d6c-4afa-8afb-971694331178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.326920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-44447808-5d6c-4afa-8afb-971694331178 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:59.328107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-44447808-5d6c-4afa-8afb-971694331178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:59.415483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 223/457] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:59.460767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d105f1-e3ce-4439-8531-d828e34ab984 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:59.583793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d105f1-e3ce-4439-8531-d828e34ab984 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:59.626562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:59.627349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.627627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.627895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.630707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:59.642722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:59.644186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:59.647862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c773-00d9-4b5c-a474-802cf9a280a5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.648431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c773-00d9-4b5c-a474-802cf9a280a5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.648935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c773-00d9-4b5c-a474-802cf9a280a5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.654013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 224/458] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:13:59.659472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.659982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.660461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:13:59.664115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:59.664952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:59.666345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:13:59.666345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:13:59.666345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:13:59.666345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:13:59.666345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 235/459] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:13:59.681687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:59.682736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:59.688188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:13:59.689609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:13:59.774290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 225/460] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:13:59.797481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:59.819710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987fa8e-539a-4647-8001-c02c45e5a44d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:59.880630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:59.881216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.881888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.881888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.882658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:13:59.882961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:59.885103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:59.907288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc19c1-46f8-49ba-ad17-4101a7718d53 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:13:59.928582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 236/461] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:13:59.937336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:13:59.951221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:13:59.956558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:13:59.957080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:13:59.957558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:13:59.967972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:13:59.972164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:13:59.973790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b7366453-e774-4ff0-89dc-2d2c5a00af52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:13:59.994974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:13:59.995822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:13:59.996639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:13:59.996639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:13:59.996639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:13:59.996639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:13:59.998692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 226/462] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:00.000104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42fe24-a3c3-4647-a399-a01669ff56d5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.000777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42fe24-a3c3-4647-a399-a01669ff56d5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.001245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42fe24-a3c3-4647-a399-a01669ff56d5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.003075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 227/463] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:00.007438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.009113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42fe24-a3c3-4647-a399-a01669ff56d5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.072775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9b7b-c226-4f95-8393-b4919048e8aa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.116242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.117240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.117691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.118410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.119854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.122051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76e27-1cf6-4d33-a458-bf27568f713e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.144037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42fe24-a3c3-4647-a399-a01669ff56d5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.153996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 237/464] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:13:59 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:00.155763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7e70-e9f6-4b96-ae31-95ec07196e5c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.156251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7e70-e9f6-4b96-ae31-95ec07196e5c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.156759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7e70-e9f6-4b96-ae31-95ec07196e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.193026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-49ba7e70-e9f6-4b96-ae31-95ec07196e5c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:00.194695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-49ba7e70-e9f6-4b96-ae31-95ec07196e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:00.216810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.217577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.218148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.218434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.219244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:00.219554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.221678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b4f79-0d8b-4c69-9e1d-0d5aa56cc138 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.238470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 228/465] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:00.243512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ea94-a529-4ce9-91b8-419015f222bc None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.244384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ea94-a529-4ce9-91b8-419015f222bc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.244599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ea94-a529-4ce9-91b8-419015f222bc None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.247284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 229/466] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:00.248528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18ea94-a529-4ce9-91b8-419015f222bc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.292408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 238/467] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:00.294124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.294614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.295082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.317361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:00.319056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:00.328401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.353961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.403038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18ea94-a529-4ce9-91b8-419015f222bc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.411842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 239/468] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:00.412724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.445636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.446968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.447504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.447944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.448912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.450629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.474180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 230/469] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:14:00 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:00.475221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.608855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99818550-8e81-4bec-86d5-6c602e6d43c2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.611452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.611917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993b37-e664-452f-9f1d-25fa639b3252 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.668209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.668942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.669221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.669494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.689347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.690840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.696470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.697306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.697587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.697862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.714242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:00.715203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:00.716004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:00.717259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:00.717259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:00.717259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:00.717259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:00.717259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 231/470] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:00.717734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.722821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:00.740899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:00.741802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:00.742690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:00.742690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:00.742690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:00.742690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:00.749443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 240/471] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:00.750911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.767816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.845883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e933-0b60-477e-9455-b1f1d6e739ab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.868661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b13f-2077-4ac3-8e47-7384fc85583e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:00.884484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.885371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.885821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.886254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.887116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:00.887558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.889128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae18c9-c652-47e4-b4e0-3ac8e412b4f2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.901726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 232/472] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:00.906740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3bdb-c700-4f32-b163-b290921de7ff None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.907180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3bdb-c700-4f32-b163-b290921de7ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.907599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c3bdb-c700-4f32-b163-b290921de7ff None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.909042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 233/473] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:00.911134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c3bdb-c700-4f32-b163-b290921de7ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:00.911276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:00.912178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.912503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.912878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.913771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:00.914198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:00.917347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69336af0-d517-4107-a3c5-424c3112af77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:00.934071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 241/474] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:00.934246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:00.935584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:00.935864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:00.936134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:00.956889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:00.958404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:01.039081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c3bdb-c700-4f32-b163-b290921de7ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:01.040169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 242/475] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:01.041863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:01.046973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:01.081286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:01.082156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:01.082543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:01.082915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:01.083721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:01.085368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:01.115140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 234/476] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:14:00 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:01.115140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:01.222387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6c86-3376-45ba-908a-f0b599ecdb60 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:01.226355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:01.238972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413f0e-e1d0-44ba-a2dc-c621c7c663c6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:01.290509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:01.291404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:01.291686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:01.291960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:01.292989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:01.294478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:01.323877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:01.324725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:01.325134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:01.325512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:01.326521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:01.328102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:01.335788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 243/477] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:14:01 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:01.350644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.sql.core [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 15:14:01.350644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 15:14:01.350644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [parameters: {'id': 'c034fbe1c69c459090b909ebd2d5e76a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 15:14:01.350644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80194) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:01.369983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return ref.to_dict() Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:01.370915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application yield resource Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise self.value Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application session.commit() Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 15:14:01.371797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.session.flush() Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application compat.raise_( Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 15:14:01.372697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:01.373568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:01.374432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [parameters: {'id': 'c034fbe1c69c459090b909ebd2d5e76a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:01.375217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 15:14:01.376018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:01.377015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 235/478] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 15:14:01 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:01.382515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:01.458009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:01.508128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb040d-2d44-4565-aa6b-779a71ae13cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:01.547363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:01.548176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:01.548450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:01.548715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:01.563161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-12bfc739-6c06-4d37-b6b2-6198dcd67446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:01.571355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:01.572851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:01.573811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 244/479] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:01.579644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:01.689290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5de5-fde0-4408-9c72-d2f754b73f65 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:01.725763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:01.726468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:01.726747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:01.728392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:01.729162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:01.729473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:01.730932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51d579-e9f9-4f17-93fc-c396e60089f7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:01.733400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:01.740002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 236/480] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:02.551933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e980a-f93c-402b-ba44-ccf3bbd73bb5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:02.552936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e980a-f93c-402b-ba44-ccf3bbd73bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:02.553430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e980a-f93c-402b-ba44-ccf3bbd73bb5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:02.555313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 245/481] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:02.560716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5fbf-3f01-4aac-9e81-9ab5c55e2b3a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:02.561520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5fbf-3f01-4aac-9e81-9ab5c55e2b3a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:02.562055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5fbf-3f01-4aac-9e81-9ab5c55e2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:02.586785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-40fc5fbf-3f01-4aac-9e81-9ab5c55e2b3a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:02.588358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-40fc5fbf-3f01-4aac-9e81-9ab5c55e2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:02.684569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 237/482] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:02.714959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e980a-f93c-402b-ba44-ccf3bbd73bb5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:02.835889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffca8-5af4-48b4-8ea8-06fe20688ec4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:02.836130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffca8-5af4-48b4-8ea8-06fe20688ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:02.836359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ffca8-5af4-48b4-8ea8-06fe20688ec4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:02.838049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 238/483] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:02.842542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:02.842825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:02.843101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:02.866818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e980a-f93c-402b-ba44-ccf3bbd73bb5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:02.879428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:02.880816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:02.904619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:02.930646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:02.932780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:02.933199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:02.933582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:02.944922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:02.953563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:02.954462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:02.955266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:02.955866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 246/484] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:02.961516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:02.979244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 239/485] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:14:03.002597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.082600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:03.135136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93411dd6-4805-43a1-9234-58ea0576d0c8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.177936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.178734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.179015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.179290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.192825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb040c-ecbf-47b7-bfe9-18fd76076700 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.206608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:03.214891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:03.215766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:03.216557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 240/486] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:03.226661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.261749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.262452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.262735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.263005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.263765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:03.264073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.272243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.288601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 247/487] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:03.289842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.342341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:03.409008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ec8c-4d45-4489-b728-c48ab9311337 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.427653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:03.449616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.450656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.451856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.452889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.454860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:03.455315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.457008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.468819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a25f8b-08a0-4401-bcec-8d5729a5cd4d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.473771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 241/488] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:03.481310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.553546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.554436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.554720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.554996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.580208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.581691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.597639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1abb-66d3-4102-a25e-ce3e846d3ae9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:03.611202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:03.612063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:03.612886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:03.612886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:03.612886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:03.612886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:03.612886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 248/489] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:03.618055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.645510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.646693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.647170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.647632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.667686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.669462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:03.699277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:03.700160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:03.700992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:03.700992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:03.700992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:03.700992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:03.711244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 242/490] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:03.712158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.754247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:03.765995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056e3ca-cfa6-4eeb-a9d0-67ef04f0334d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.775671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:03.818472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.819122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.819408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.819687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.820408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:03.820716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.822819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1050-b027-4ecb-930b-5205bd16ae37 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.836374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 249/491] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:03.837891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0145ec-48c5-42f6-b348-a3cad2d7c525 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.838420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0145ec-48c5-42f6-b348-a3cad2d7c525 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.838901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0145ec-48c5-42f6-b348-a3cad2d7c525 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.844464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 250/492] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:03.845426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0145ec-48c5-42f6-b348-a3cad2d7c525 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:03.861281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b342d-b66c-46d1-a465-7ef85a44129d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:03.897644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:03.898344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.898628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.898902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.899629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:03.900046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:03.901477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c83e9-ec9f-415a-8a18-2f13ab127fa4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:03.914033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 243/493] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:03.915267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:03.915583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:03.915863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:03.938927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:03.940044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:03.969043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0145ec-48c5-42f6-b348-a3cad2d7c525 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.008015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64978149-e686-4f71-8048-10af97405f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.008961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64978149-e686-4f71-8048-10af97405f55 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.009882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64978149-e686-4f71-8048-10af97405f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.010331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64978149-e686-4f71-8048-10af97405f55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.018689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64978149-e686-4f71-8048-10af97405f55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.020370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64978149-e686-4f71-8048-10af97405f55 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.029254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 244/494] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:04.030169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-64978149-e686-4f71-8048-10af97405f55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:04.036989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:04.037852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:04.039364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 251/495] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:04.045221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64978149-e686-4f71-8048-10af97405f55 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.055493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.070423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.137445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce424df3-831b-4d09-ab3f-551c75c6afbc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.161824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64978149-e686-4f71-8048-10af97405f55 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.174441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.175356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.175639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.176105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.184571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.186326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.195891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.196554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.196865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.197137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.198014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:04.198319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.199741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b961db-b647-41e3-8e2a-56f427c3a3d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:04.203265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:04.204132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 245/496] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:04.209861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 252/497] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cc1b-a117-46b8-92e5-6c4f0519345e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cc1b-a117-46b8-92e5-6c4f0519345e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cc1b-a117-46b8-92e5-6c4f0519345e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 253/498] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:04.240863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50cc1b-a117-46b8-92e5-6c4f0519345e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.304401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.322550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.327646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b9a38-1b96-414f-8339-b1fa0090aa71 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.356413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50cc1b-a117-46b8-92e5-6c4f0519345e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.364029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.364824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.365107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.365378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.377718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:04.385427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:04.386344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:04.387109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:04.391842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 246/499] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:04.392445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.394063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.394725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.395009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.395276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.396427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:04.396427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.397847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da6948-39d4-451b-b091-d431307cfc49 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.417718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 254/500] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:04.418831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.419114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.419388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.435068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:04.436249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:04.503516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c18e-528e-427c-a6c4-80d5805b42bb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.513839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 255/501] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:04.515122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.544207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.544864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.545156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.545435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.559035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.576008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.618883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424366e-7977-4f85-a90e-0620a4b7d6b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.619753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.621231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.652255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.652917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.653198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.653477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.654254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:04.654557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.655939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.663594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 256/502] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:04.664375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.719659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 247/503] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:04.720488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.762705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.769278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a51a4b-37cc-437a-8052-dfd7c642df26 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.791104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.802941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.803586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.803869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.804149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.817951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69307-8b03-48dc-851e-a668fe3a4402 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.852418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:04.853196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.853474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.853745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.863710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:04.870488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-29bb56e0-1e01-447f-b7c2-211e5c97fb48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:04.871392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:04.872316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:04.873106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:04.873689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:04.873755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 248/504] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:04.873755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1313-bcd6-4ae8-8abc-c152eb3cfb6f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:04.874067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1313-bcd6-4ae8-8abc-c152eb3cfb6f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:04.874338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1313-bcd6-4ae8-8abc-c152eb3cfb6f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:04.875574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 249/505] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:04.876260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1313-bcd6-4ae8-8abc-c152eb3cfb6f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.974864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 257/506] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:04.975698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:04.982398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1313-bcd6-4ae8-8abc-c152eb3cfb6f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:04.983956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:04.998833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.020551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.021275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.021556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.021829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.032609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.034112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:05.051134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.052105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.052952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:05.052952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:05.052952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.052952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:05.052952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 250/507] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.053224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.075099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb72d-7635-442a-aed9-1b8ec3838fec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.107924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.108697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.108975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.109247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.119034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.120478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-45ec6cb5-3d6a-4762-ae2e-7cb487710886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:05.138345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.139300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.140133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:05.140133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:05.140133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.140133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:05.140133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 258/508] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.140971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.141234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.141501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.155148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dd1b-c9d0-4e0f-8036-1e890dffdcf9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.158311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:05.159065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:05.199597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.200270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.200551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.200824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.201571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:05.201876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.203724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.212879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 251/509] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:05.213599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.233280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.237737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 259/510] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:05.239985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.246558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.334779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8a6c-38e3-4bd1-8033-0088fedc6153 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.363381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac159-a312-41e0-a7d6-b949098d8046 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.374455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.375590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.375964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.376151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.387515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.389026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.400545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.401207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.401487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.401759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.402575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:05.402875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.404246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:05.407421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.408241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.409071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:05.409071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:05.409071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.409071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:05.409071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 252/511] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.409740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.416504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 260/512] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:05.420627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.485007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.494042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.526138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4894-8506-46d2-bc09-d4a25e541d68 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.529087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd85c2-a22f-43ef-9f88-88c63655f9e1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.558422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.559142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.559421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.559687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.562211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.562868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.563152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.563427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.564145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:05.564449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.565837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.569815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.571282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.578015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 253/513] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:05.578802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:05.589320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.590743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 261/514] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.591573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.685599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b590ce-2eb1-46c0-bd9c-cfd4cd97a5ba None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.689402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04a827-643e-414b-8336-97ccf68f1e0d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.706025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.713097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.721969 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.722752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.723032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.723300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.724380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.725027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.725306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.725575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.726314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:05.726618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.728015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.733710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.735162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.738962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 262/515] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:05.739641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:05.752388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.753222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.754097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:05.754097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:05.754097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:05.754097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:05.754097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 254/516] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.754365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.844415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adbf0-f964-49ab-b763-0d362d688ab4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.856155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f95e-011e-4839-9572-82d301ac92b5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:05.877347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.878170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.878456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.878731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.886638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.888096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.891692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:05.892472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:05.892754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:05.893028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:05.899612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:05.901723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:05.902636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.903577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:05.904667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 263/517] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.905320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:05.918477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:05.919365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:05.920185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 255/518] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:05.920658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:05.942334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:05.962550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.006936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d054dc-ece2-4ff5-b366-7a8dd2f75ee7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.024802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09475-73c6-40dc-b1be-48b67e3bfaf5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.043099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.043782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.044061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.044329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.045037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.045337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.046744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.058006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 264/519] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.058773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.059047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.059868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.060150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.060425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.067379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.068814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:06.083288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:06.084116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:06.084935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 256/520] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:06.085388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.156974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.163222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22c73-db76-4eff-9254-05c374115489 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.179103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.182768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd7d2-710c-4d7f-ba62-9acde254ae3d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.195976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.196628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.197469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.197743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.198496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.198798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.200188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.211836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 265/521] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.212664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.217056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.217715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.218025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.218300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.219126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.219427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.220835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.256862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 257/522] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.257488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.317407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216426e0-6b53-4c7f-8d68-dac8fccca116 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.350419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.351072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.351349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.351626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.352426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.352729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.354725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.359479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3574b-de1d-4abc-86db-2ad6deabb2fd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.372031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 266/523] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.372837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.391534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.399543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.400330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.400604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.400874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.407912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.409322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:06.423893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:06.424933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 258/524] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:06.430525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.444854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.471641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57468a90-0092-4af6-a5bf-a58c29bfb30f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.504364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.505018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.505299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.505600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.506421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.506735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.508171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.520714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 267/525] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.520714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.528617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054092d2-c63f-444b-8a16-06a5b9b7c847 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.562458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.563128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.563415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.563689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.564389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.565813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.585294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 259/526] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:14:06 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:06.586112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.608621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.641710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4d65-123f-4dc9-bb97-ed339a7e74f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.679925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.680507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.680789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.681071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.682057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.714453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf005c-a7ed-4a2e-a402-81e112190b76 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.753913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.754587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.754871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.755144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.755973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.756286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.757727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.763460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 260/527] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.765818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.767371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.770823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.852536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.879293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 268/528] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:06.884122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:06.905050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8719b6-a524-4def-981d-c3c6a48a6302 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:06.944520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:06.945421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:06.945869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:06.946176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:06.947585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:06.947917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:06.949338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:06.958280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:06.969452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 261/529] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:06.974475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.000774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451a3a-d2ec-4673-94c1-0c624894ca81 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.049284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.050492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.050949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.051624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.053522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=bb8ca62c1d2e458d9831415740222bdd) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:07.054036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.055655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.064136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 269/530] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/role_assignments?user.id=bb8ca62c1d2e458d9831415740222bdd&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:07.065871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.088728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654460f-1ac9-4ef0-aed6-74b9ba17c5ef None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.119300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:07.139364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.140736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.141192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.141664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.154580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.157045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:07.179183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:07.180099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:07.180925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:07.180925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:07.180925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:07.180925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:07.184691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 262/531] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:07.189825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.250583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0380742-50ff-490d-afc3-3d4a35bdef25 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.279863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:07.323343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.324294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.324769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.325278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.398874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c61715-0aa4-4354-b109-ac9eccef3ed4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.453287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.454801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.471038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.471715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.471995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.472273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.473003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:07.473312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.474761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.500570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 263/532] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:07.505574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.535721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:07.606219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 270/533] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:07.613937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.720022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17c6bf-92a7-4f51-bce6-3a321b2ac1ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.739429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b24a5f-d926-416d-b382-a71346f47b69 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.756426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:07.758308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.759806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.760013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.760389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.770261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:07.772558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.774378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:07.798053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:07.798893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:07.799726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:07.799726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:07.799726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:07.799726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:07.799726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 271/534] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:07.800956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.814180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.814981 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.815263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.815537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.830511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.831970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:07.870624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:07.871497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:07.872309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 264/535] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:07.877682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:07.921424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224eab-c5eb-48c2-bb80-247c599bacb5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:07.968077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:07.968745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:07.969028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:07.969302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:07.970060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:07.970374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:07.971764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:07.984373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 272/536] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:07.989366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:08.085669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:08.097674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593274e6-fb6d-4c0b-b4cb-c5448ac6727d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:08.138508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b4378-df1a-48da-937d-99a64796e20b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:08.139485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:08.140149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.140689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.140963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.141749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:08.142091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:08.143523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:08.173235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:08.174055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.174338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.174611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.177688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 265/537] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:08.183000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:08.183741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:08.184456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:08.205636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:08.206470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:08.207360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 273/538] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:08.215133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:08.218459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:08.319488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e07e8e-7502-45ff-b364-44c7c5e38624 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:08.357141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:08.357735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.358055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.358644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.359774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=fa7ffb1028c44466a4192e0c17bb7df0) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:08.360086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:08.362109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:08.370750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 266/539] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:08 2022] GET /identity/v3/role_assignments?user.id=fa7ffb1028c44466a4192e0c17bb7df0&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:08.385575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942a0d6-b036-41b1-8025-44f5a85765e9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:08.411959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:08.424923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:08.425624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.425935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.426215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.427012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:08.427371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:08.428882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690c3a5-16fa-4787-9c9f-9d8ebfa50f1c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:08.442831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 274/540] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:08.448801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:08.598050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:08.614173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbb45f-6a2d-4a4d-931e-0a77a45e262e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:08.657520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:08.658213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.658497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.658773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.659608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=9c21819f774b4052bced3ef15f6d83d0) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:08.659921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:08.661376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb5e8-0cfa-4e52-828a-77373778674f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:08.672505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 267/541] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:08 2022] GET /identity/v3/role_assignments?user.id=9c21819f774b4052bced3ef15f6d83d0&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:08.954587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377aa8a-8512-4457-a90c-b0c1205b9feb None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.955287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377aa8a-8512-4457-a90c-b0c1205b9feb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.955287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377aa8a-8512-4457-a90c-b0c1205b9feb None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.956793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 275/542] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:08.962258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:08.962803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:08.962954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:08.990931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:08.992147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:09.002514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639178-0dde-4d7e-abdf-a0e1c0f7b3a1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.002798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639178-0dde-4d7e-abdf-a0e1c0f7b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.003081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639178-0dde-4d7e-abdf-a0e1c0f7b3a1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.004629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 276/543] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:09.010842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.011428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.011903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.033261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:09.034873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:09.112859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 268/544] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:09.144224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 277/545] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:14:09.151227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.222017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.261339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.286299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0e05-1d8b-4bae-9939-ec5164978d86 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.358434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.359245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.359527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.359801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.382123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:09.392062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:09.392955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:09.393720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:09.401245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 269/546] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:09.403768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.428294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ca63-211f-4fd2-b3f1-8ad46f443eb5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.430106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.500393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de88661-9223-408d-b97b-813066639817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.501170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88661-9223-408d-b97b-813066639817 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.501452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88661-9223-408d-b97b-813066639817 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.501724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88661-9223-408d-b97b-813066639817 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.513247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de88661-9223-408d-b97b-813066639817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2de88661-9223-408d-b97b-813066639817 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:09.521281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:09.522202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:09.522997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 278/547] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:09.524231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e757-8476-41a9-bf67-fc7b91cf6e3e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.524328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e757-8476-41a9-bf67-fc7b91cf6e3e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.524590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e757-8476-41a9-bf67-fc7b91cf6e3e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.526709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 279/548] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:09.531418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973e757-8476-41a9-bf67-fc7b91cf6e3e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.537923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577419-3537-430e-97d3-c784ab8a9d2a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.583480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.584978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.585462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.585926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.586843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:09.587370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:09.590270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7dac3-358f-4a0c-b437-25371b94b585 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:09.602080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 270/549] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:09.604379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.604843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.605289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.625871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:09.627895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:09.630769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.638848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973e757-8476-41a9-bf67-fc7b91cf6e3e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.674106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.675076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.675578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.676033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.676955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:09.677440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:09.679213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:09.688883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 280/550] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:09.689969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.721941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 271/551] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:09.722120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.722195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.811377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbd149-5413-4d8b-8a6b-97e5756c4f2b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.833548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216fea6-66d4-481b-8d2e-1f0f19dcfcd6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:09.846686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.848197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.848759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.849283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.860570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:09.862351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:09.869704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:09.870446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:09.870726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:09.870997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:09.877752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:09.883157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:09.884265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:09.886153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:09.886153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:09.886153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:09.886153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:09.886153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 281/552] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:09.886436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.894936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:09.896449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:09.917534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:09.918657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:09.919678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:09.919678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:09.919678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:09.919678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:09.921955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 272/553] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:09.923145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:09.972665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:09.996962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9690f-c5aa-4086-88ad-012b514d807c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.035733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.036586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.036834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.037111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.039201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7210686-0298-406a-b3a1-e7c0a5a3c184 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.049802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:10.058785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:10.059689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:10.060630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 282/554] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:10.061620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.084158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.085173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.085662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.086257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.087241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.087757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.089538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.102826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 273/555] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.104439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.158100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.178200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800dccc-d53b-4f78-8d32-d30256b1acaa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.212608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457456-3b94-4689-a81f-f1fe5e6a694b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.214621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.215314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.216279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.216279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.216775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.217086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.218551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.220880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.236817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 283/556] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.236817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.260221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.261247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.261860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.262471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.263422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.263933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.265986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.275217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 274/557] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.277053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.341832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f891-adf9-4747-8940-6d8bdbc71316 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.378063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.378948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.379229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.379500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.387959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.389300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716d1b-a653-45eb-9e21-60eb581e749a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.389519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.404269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:10.407249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:10.411385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:10.412296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:10.413481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 284/558] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:10.414110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.432685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.433818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.434357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.434914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.444196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.445646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:10.461487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:10.463386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:10.464372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:10.467848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 275/559] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:10.468705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.485928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.546368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec920-64bf-4900-b021-d2d418821f56 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.582151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.583221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.583578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.583928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.594908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551bc24-56d5-49e7-9385-39f86f14acf9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.598927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.600519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:10.624823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:10.625749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:10.626646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:10.626646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:10.626646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:10.626646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:10.626646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 285/560] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:10.628101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.637850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.638792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.639272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.640219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.641524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.642491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.644686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.674174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 276/561] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.676185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.711393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.771006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2762-8bd4-4f27-8dd2-8f453e4f1450 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.784185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.792199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68da3-620a-43fa-9de4-72e12881bbcf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.818875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.819561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.819847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.820121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.821218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.821555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.824448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.830787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.831862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.832342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.832811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.833748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:10.834274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:10.835853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345de5e-9d44-4dd6-94cf-7454b57d930d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:10.847507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 286/562] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.848949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.849183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 277/563] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:10.850704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc049cf-5a1b-404c-b3fb-82e386b3b4a1 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.851193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc049cf-5a1b-404c-b3fb-82e386b3b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.851662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc049cf-5a1b-404c-b3fb-82e386b3b4a1 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.853141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 278/564] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:10.853889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc049cf-5a1b-404c-b3fb-82e386b3b4a1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:10.951580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:10.961607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff2f-4764-4fb9-ad2e-7d04b5093b9f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.965107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc049cf-5a1b-404c-b3fb-82e386b3b4a1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:10.995888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.996535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.996818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:10.997092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:10.998831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:10.999613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:10.999892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.000163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.011717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.013185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:11.031207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.032178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.033245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:11.033245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:11.033245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.033245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:11.033648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.033736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 279/565] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.033736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.066917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.068382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcd10a-d72b-464f-b77e-9cb62c8c5b9d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.134742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5c6e-c7d9-41db-9970-706220dfe36f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.167697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.168227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 287/566] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:11.168473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.168750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.169018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.169567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.169848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.170182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.178700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.180222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.186403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:11.187655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fc7c11a0-7e98-4431-9da2-08358bff6317 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:11.194550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.195441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:11.196369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 280/567] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.197518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19116-749a-4466-9e32-85f45a615145 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.197702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19116-749a-4466-9e32-85f45a615145 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.197979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19116-749a-4466-9e32-85f45a615145 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.199351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 281/568] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:11.199876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19116-749a-4466-9e32-85f45a615145 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.202514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.252095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.260267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 288/569] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:11.261073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.308491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19116-749a-4466-9e32-85f45a615145 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.343749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be312-ac30-4585-b055-13db822ba249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.344402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be312-ac30-4585-b055-13db822ba249 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.344681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be312-ac30-4585-b055-13db822ba249 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.344951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885be312-ac30-4585-b055-13db822ba249 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.345666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885be312-ac30-4585-b055-13db822ba249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:11.345993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885be312-ac30-4585-b055-13db822ba249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.347360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885be312-ac30-4585-b055-13db822ba249 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.358665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 282/570] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:11.359436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be312-ac30-4585-b055-13db822ba249 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.363582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcc489-d070-4bed-bc9c-e124e098445e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.397856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.398597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.398877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.399145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.409340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.410871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.419655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-30e84070-1f46-450c-b73a-563f5ced6a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:11.427966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.429015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.430122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:11.430122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:11.430122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.430122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:11.430122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 289/571] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.430467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.430548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.430824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.448632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:11.449783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:11.463500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885be312-ac30-4585-b055-13db822ba249 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.496797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.497055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.497795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.498051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.498450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.499164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:11.499469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.500920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.518867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 283/572] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:11.519735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.524330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 290/573] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:11.525275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.617726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979506f-d857-40c6-b4da-25199a2a8840 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.623890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209f64f-c2a7-439e-b48b-c6a88ccbaefd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.637524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.652591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.653316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.653592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.653856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.657534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.658339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.658619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.658886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.664157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:11.665645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.667123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:11.671819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.672914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 284/574] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.673943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:11.682928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.684041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:11.684914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 291/575] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.685497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.727317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.778048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa214-e848-41be-97e6-b4ff9e00bad0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.786914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e43997-31be-47f2-8517-02ca8667d7f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.811130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.811790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.812073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.812350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.813065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:11.813371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.814799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.820003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.820799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.821078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.821350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.826874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 285/576] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:11.827566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.831997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.833448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:11.851397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.852259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.853321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:11.853321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:11.853321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:11.853321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:11.853321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 292/577] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.854112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.873360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.930120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394bf-a692-4fc0-9dfa-2a07827a53e7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.942615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:11.952933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b299-f7eb-45a3-a70a-704dc61d8b0f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:11.964156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.964945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.965229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.965499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.975400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:11.983767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:11.984823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 286/578] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:11.985840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:11.986718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:11.987269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:11.987548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:11.987823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:11.988564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:11.988868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:11.990273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:11.998795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 293/579] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.000327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.087929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.090990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2567263-a29d-41b5-84fe-bff00a9b41cf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.100844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0abac-5c4a-4d0a-aad7-6728808c6ee6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.124223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.124879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.125162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.125437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.126255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.126563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.127996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.133826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.135247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.135529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.135802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.140961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 287/580] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.141561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.147123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.148595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:12.163218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:12.164152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:12.165056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 294/581] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:12.165577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.179332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.244569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cd7fc-b8f5-4be0-8b43-9796cf482a67 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.263626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1699-711d-4561-9927-e5ab0539292d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.277765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.278443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.278726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.279001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.279717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.280014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.281410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.293237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 288/582] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.294064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.300964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.304307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.304307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.304307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.304307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.304307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.304700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.313406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 295/583] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.314018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.322986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.386171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.401734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9732-7cce-4a5b-b238-c76884a6eac4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.410618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630916d1-7720-4483-a974-e02c546ed802 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.435160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.435944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.436224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.436501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.443810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.444683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.444970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.445240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.446906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.448392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.459202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=92191aff46eb4e98b5923c3ad95a8012, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.460640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:12.465148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:12.466314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 289/584] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:12.467229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.477680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 296/585] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:12 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:12.479246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.546132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.579956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e925-a5aa-4b43-9578-38aa7f4c7cbd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.595298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee25ff-edfb-414d-b201-11e1afbb0c64 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.616587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.617274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.617612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.617920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.619322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.619636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.621101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.621751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.635906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 290/586] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.636988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.641236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.642985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.642985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.642985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.650449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.651902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:12.668534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:12.669454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:12.670364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 297/587] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:12.670850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.751178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e6c8f-fdd6-4e93-9521-ac8e5fe79667 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.783848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.784216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44262-1b0b-456f-9f5d-9e939790888f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.791832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.793382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.793847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.794649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.807936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.809445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.819070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.819951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.820418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.820875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.821823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.822311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.823829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:12.827592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:12.828651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:12.829641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:12.829641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:12.829641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:12.829641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:12.829641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 291/588] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:12.830110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.840003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 298/589] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.841124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:12.895593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:12.943596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5c7f4-4357-49ec-a9d6-c360aa920369 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.955659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370a313-0d7a-437e-92bf-476eed85b08d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:12.979369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:12.980173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:12.980447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:12.980722 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:12.981547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=530cf69a596d42eeb576903bb39816cc) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:12.981859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:12.983332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:12.997928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 292/590] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/role_assignments?user.id=530cf69a596d42eeb576903bb39816cc&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:12.997928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.004417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.005647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.005647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.006024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.006822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:13.007129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.008805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.024297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 299/591] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:13.025284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.066626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.134802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead42856-4fce-4964-851b-090c903a6ae9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.142285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e57f-1079-46d4-9ee5-8991a5302e5a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.146028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.183323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.184525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.185016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.185494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.190543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.191215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.191493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.191764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.192485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:13.192784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.193727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.195264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.195370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:13.211920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:13.212924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:13.213829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:13.214413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 293/592] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:13.214413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.214558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 300/593] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:13.214558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.333876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb250-dd6b-48c2-adb9-aae56bbd5f7d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.344349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.367275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd3de-1b1e-4d07-88e4-eb35a23b81ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.375043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.376174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.376654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.377153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/bb8ca62c1d2e458d9831415740222bdd/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.393077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=bb8ca62c1d2e458d9831415740222bdd, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.394846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.409745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.416188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.416188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.416188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.416506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 294/594] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:13 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/bb8ca62c1d2e458d9831415740222bdd/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:13.416506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.426040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.430516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:13.458495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:13.459498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:13.460433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:13.466803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.529402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.619384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87887a0-bb9b-4a97-93dd-8457b86ae06c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.653464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ba3d-2b7e-4fce-82eb-7d941a986ef2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.659090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.659841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.660184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.660532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.661465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:13.661836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.663521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.684739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 295/596] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:13.688319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.694608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.695515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.695998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.696467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.697613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:13.698121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.699878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.707303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.721587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:13.726866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.807312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86a51-2405-4c29-8895-466ace0eef85 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.837358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:13.859676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51338-e31e-4373-a576-07cd6dc005b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:13.898463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.898678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:13.899353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.899631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.899949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.900388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:13.900882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:13.901354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:13.913065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.914794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.919257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:13.920772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:13.936160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:13.937041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:13.938034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:13.938034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:13.938034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:13.938034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:13.940253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 303/598] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:13.949933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:13.959084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:13.959930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:13.960810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:13.960810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:13.960810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:13.960810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:13.962481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 296/599] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:13.970971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.103609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.153198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46143d75-a681-4f4a-9228-a32fedf4e16d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.154694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67645cdb-67fb-410e-9028-eadc27fc1cb2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.190684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.191360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.191629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.191900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.192640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:14.192944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.194543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.207063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 297/600] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:14.212957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.221854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.222854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.223367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.223853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.224785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:14.225311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.226938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.238294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.249873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:14.259536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.327554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfbd3b-803e-4089-842f-cd095610e1dc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.362351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.367264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.369231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.370836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.371955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.386710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.389135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:14.412794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:14.413682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:14.414577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:14.430572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 298/602] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:14.433671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.464803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042049d-c90a-4a04-be73-34f34c56bb83 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.531453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.532525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.532949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.533360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.546788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.549913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:14.577659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:14.578794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:14.579894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:14.582595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 305/603] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:14.593851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.594383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c60fd-9664-4c9d-8fd7-6a308266bd9b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.670220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.670806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.671095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.671370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.672159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:14.672464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.673908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.702758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 299/604] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:14.705095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.711191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.761357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae5ab-53ed-4f00-a61b-31b87597bcf3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.777116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.800766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.801429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.801709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.802027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.802844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:14.803129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.804551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e93e-c0ac-4abf-8984-9bf0cfda3518 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.818466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 306/605] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:14.819959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c9c8-b9e8-4475-88d9-bfd8c1b6fd77 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.820257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c9c8-b9e8-4475-88d9-bfd8c1b6fd77 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.820525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0c9c8-b9e8-4475-88d9-bfd8c1b6fd77 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.826491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 307/606] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:14.827282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c9c8-b9e8-4475-88d9-bfd8c1b6fd77 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:14.845026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9706-a348-476c-8bc4-02fe6c3bbdb0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.891994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:14.894206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.894815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.895279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/fa7ffb1028c44466a4192e0c17bb7df0/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.916104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=fa7ffb1028c44466a4192e0c17bb7df0, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:14.918618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca25d0-c6a6-4866-88a1-a495d1fd16eb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:14.946138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 300/607] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:14 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/fa7ffb1028c44466a4192e0c17bb7df0/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:14.946138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531267b-7b0d-4148-a2fe-91d249365f52 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:14.946138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531267b-7b0d-4148-a2fe-91d249365f52 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:14.946138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531267b-7b0d-4148-a2fe-91d249365f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:14.947423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0c9c8-b9e8-4475-88d9-bfd8c1b6fd77 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:14.977386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:14.982716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0531267b-7b0d-4148-a2fe-91d249365f52 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:14.985207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0531267b-7b0d-4148-a2fe-91d249365f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:15.006265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.007469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.007760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.008101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/9c21819f774b4052bced3ef15f6d83d0/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.030158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=9c21819f774b4052bced3ef15f6d83d0, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:15.031759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:15.050371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 308/608] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:14 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/9c21819f774b4052bced3ef15f6d83d0/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:15.131820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 301/609] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:15.160488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.224652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34538a4-4dce-4464-9d7a-ec98f815b75c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.225156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34538a4-4dce-4464-9d7a-ec98f815b75c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.225156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34538a4-4dce-4464-9d7a-ec98f815b75c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.226813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 302/610] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:15.234049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.234349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.234606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.257147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:15.258381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:15.277526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a4ef2-1982-47ac-88e5-88635b25c32f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:15.316409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.317494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.318001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.318497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.325166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:15.329822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:15.333513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 303/611] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:15.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:15.343320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:15.344131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:15.346875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 309/612] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:15.353864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.366768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.424094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:15.474481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba6d4-0d8e-49e1-ba1b-0520dabde661 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:15.517592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.518225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.518509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.518784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.519544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:15.519853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:15.521247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:15.530648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 304/613] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:15.538922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.567802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961dbf1-56bd-4abc-b20b-785c3f879d94 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:15.591073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:15.607470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.608268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.608548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.608820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.624254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:15.636155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:15.637051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:15.637867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 310/614] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:15.643874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.722607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7106-b442-49eb-8346-1daf619adb16 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:15.762821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.763617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.764088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.764361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.783447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:15.783447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:15.817081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:15.818206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:15.819304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:15.819304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:15.819304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:15.819304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:15.819304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 305/615] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:15.825418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:15.825572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.843131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e821b4b-10d4-40a2-bc5f-0ffc8dab5c7b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:15.915648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:15.916574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:15.917036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:15.917457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:15.918394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:15.918843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:15.920379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:15.932583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 311/616] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:15.939281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:15.942748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:15.981540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8dcba-1ef7-4701-9fbb-893fe6c4076b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.027653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.028848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.029282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.030300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.031427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:16.031885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.034365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8ff0-46ce-4760-bf2c-9e4048f0ff66 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.057438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 306/617] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:16.057438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123613cb-4e17-47b9-a509-dead6d244e9b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.057438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123613cb-4e17-47b9-a509-dead6d244e9b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.057438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123613cb-4e17-47b9-a509-dead6d244e9b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.061382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 307/618] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:16.062095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123613cb-4e17-47b9-a509-dead6d244e9b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.074223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419740f7-6f3d-449a-a1a0-16412ee1be5f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.111946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.113280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.113776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.114307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.126562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.128317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.135304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a2c9391a-986a-44f5-98f1-c71c736883c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:16.148452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:16.149340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:16.150301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:16.150301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:16.150301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:16.150301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:16.152957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 312/619] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:16.154363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.155060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.155628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.176091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123613cb-4e17-47b9-a509-dead6d244e9b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.178336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:16.180127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:16.219511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.227520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.229627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.230147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.230626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.240637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.242762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.261345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 313/620] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:16.261872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:16.262919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:16.264009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:16.264533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.272406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 308/621] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:16.274176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.394150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d6ce9-768a-4730-a4ee-1f29f9369758 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.411857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923cf0d-10cb-43e3-992d-81215416c8d1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.423306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.433123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.434177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.434714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.435186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.436097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:16.436613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.438197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.450349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 314/622] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:16.455224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.458573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.459257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.459530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.459828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.461530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:16.461843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.463859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.487019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 309/623] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:16.488296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.550134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.580169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cca161-7a48-49cb-b600-0f2ff617c0d2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.613503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef50351-a14f-4b55-92e2-fe7b44da8b09 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.616300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.617324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.617803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.618317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.629353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:16.637685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:16.638583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:16.639394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:16.642354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 315/624] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:16.643378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.655947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.657100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.657390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.657667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.667662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.669130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:16.687385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:16.688317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:16.689241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:16.693681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 310/625] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:16.694550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.706061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.761173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8377a3e-37da-41d8-8f38-fb49e95c57bd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.803091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.803756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.804292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.804577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.823295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38302c2c-f7d1-406b-88d9-0a32003f514d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:16.835763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:16.863398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:16.864412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:16.864909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:16.865414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:16.866707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:16.867214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.868821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.878699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 311/626] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:16.879835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:16.898677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:16.901754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:16.956984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.001006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abfa7d-fb3d-4539-8e63-a42da12153c5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.026276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 316/627] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:17.027447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.047433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.048552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.049079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.049578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.050651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:17.051252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.052986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.073078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 312/628] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:17.074242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.112197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.164317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59534-bc2c-4964-ae44-5ec84c06cab0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.191383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d822b-2f6f-4414-bfe1-4a48ccb6eb5f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.211131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.211935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.212753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.213031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.227348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.229700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.233357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.234851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.235330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.235814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.239723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.248634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.250781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:17.250979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.251809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.252715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:17.252715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:17.252715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.252715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:17.256861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 317/629] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.257808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:17.277264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.278221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.279089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:17.279089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:17.279089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.279089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:17.284740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 313/630] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.285869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.374072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b167d-8c0a-4711-90b8-fda5a7ed205f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.375351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.393396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1ae8c-e5d3-4dd5-ade4-f92eb90af16d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.409287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.410104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.410387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.410658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.420991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.422499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.426845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.427510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.427794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.428071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.428792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:17.429101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.430499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82d53a-260d-4481-8ac2-05b5f5c478bf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:17.440141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.440976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.441844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:17.441844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:17.441844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:17.441844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:17.441844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 318/631] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.442652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.442752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 314/632] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:17.443735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844223f-8230-46da-be8f-a5735c5e2e8c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.444021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844223f-8230-46da-be8f-a5735c5e2e8c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.444298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844223f-8230-46da-be8f-a5735c5e2e8c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.445520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 315/633] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:17.446876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beddc0-039b-45af-b970-697b4f3a9c8f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.447168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beddc0-039b-45af-b970-697b4f3a9c8f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.447447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beddc0-039b-45af-b970-697b4f3a9c8f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.448788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 316/634] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:17.450695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beddc0-039b-45af-b970-697b4f3a9c8f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.501722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.548711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b0276-fe36-4b64-9099-b6ae74aca88c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.552923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58beddc0-039b-45af-b970-697b4f3a9c8f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.581658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.582345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.582712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.582989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.583705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:17.584006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.585369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ff4a-20c9-46f4-8954-b84d704a5da5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.586011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.586670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.586954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.587822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.588539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:17.588841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.590213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.596806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 319/635] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:17.598023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f63bc-5770-4126-8f06-af2fd80950e8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.598320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f63bc-5770-4126-8f06-af2fd80950e8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.598593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f63bc-5770-4126-8f06-af2fd80950e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.601517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 317/636] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:17.605610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.608349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.616450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e41f63bc-5770-4126-8f06-af2fd80950e8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:17.617650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e41f63bc-5770-4126-8f06-af2fd80950e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:17.683229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 320/637] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:17.684417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.684701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.684975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.700995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:17.702186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:17.713001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6fa-c2cf-4750-9a5c-821bc2bbd77b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.737275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.746269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.747127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.747409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.747670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.756223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.757647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.770373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 321/638] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:17.771191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:17.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.774614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:17.776116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 318/639] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.776705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.838347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:17.874491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71573-05b6-4f92-b409-1ecd8c20089d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.877920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6496b5-2ece-49ab-a72a-9de31b0ef999 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:17.907692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.908477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.908758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.909029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.910861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:17.911717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:17.912067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:17.912414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:17.916132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.917565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.919594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:17.921023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:17.930935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.931975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 322/640] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.937578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:17.938169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:17.939031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 319/641] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:17.939919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:17.969932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.034211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d892e-4383-4355-a0c9-170f99951111 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.036943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3541-1f0f-430b-bc9b-b2712e1987ee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.056911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.069290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.069969 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.070255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.070531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.070804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.071360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.071614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.071711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.071897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.072168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.073093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.082087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:18.090228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:18.091178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:18.096893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:18.097719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 320/642] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.097815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 323/643] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:18.097926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.098012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.185927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.192043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fe6b1-b3d7-4250-95c1-4ca9c95f6fc8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.194958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f691f6-5c53-4a6b-af0c-8ddc6c0e580d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.225007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.225791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.226095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.226365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.230226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.230883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.231168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.231451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.232241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.232549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.234052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.237235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:18.244837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:18.245947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:18.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 321/644] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:18.247470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 324/645] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.247470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.248843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.291715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.348958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7854d-2ebe-448f-bdaa-a68c0a74ec52 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.351949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ef78b-0142-4cf6-b53c-c297c520aa6d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.381580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.382252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.382542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.382820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.384707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.385361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.385642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.385942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.386738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.387046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.388480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.401135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 322/646] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.401941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.409020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.455354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.456841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.496989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.500011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a54-a838-49d6-94a8-1fb2beaaa7b2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.535195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.535855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.536137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.536418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.537152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.537457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.538846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.546726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 323/647] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.547495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.561637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 325/648] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:18.561637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.608421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.647741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa3e6e-4dfa-4f92-ad81-f663368091c1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.654513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5eafd-4325-4d5f-a591-8e5ccd2bb808 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.680610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.681774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.682079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.682360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.683093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.683396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.684750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.687614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.688257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.688541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.688817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.689632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:18.689968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.691376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.692615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 324/649] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.693152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.701233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 326/650] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:18.702047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.730707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.815223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aafbe-7ae6-46e0-bbe8-bf172c4dcaf9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.818680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5994eb5-f72e-4cb4-8bea-dc8e19577a40 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:18.838012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:18.855028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.855923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.856201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.856466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/530cf69a596d42eeb576903bb39816cc/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.857781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:18.858608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:18.858891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:18.859165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:18.872294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.873803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.877082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=530cf69a596d42eeb576903bb39816cc, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:18.878556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:18.893795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:18.894731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:18.895593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:18.895593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:18.895593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:18.895593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:18.895809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 325/651] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:18 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/530cf69a596d42eeb576903bb39816cc/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:18.895809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:18.895933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 327/652] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:18.896544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.000092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.031408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e217ce-fb89-4c68-a144-0d6611e74942 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.032146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253867f-abc3-41e2-b4d0-8ba7edb6da5c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.070821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.071382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.071656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.071940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.072213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.072313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.072497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.072825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.083957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.084465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.085450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.085964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:19.103826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:19.104769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:19.105715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:19.105715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:19.105715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:19.105715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:19.106045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:19.108021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:19.110124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:19.110124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:19.110124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:19.110124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:19.110609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 328/653] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:19.110745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 326/654] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:19.110891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.116370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.162333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.229369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c754c7-c86d-4b7e-9833-f7a6777ff279 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.231870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64c5e-97d5-47a4-9419-e9146b9aee29 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.259347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.270651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.271470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.271900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.272274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.273114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:19.273520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.275087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.275354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.276492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.276915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.277523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.279224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:19.279681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.288296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.295163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 327/655] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:19.296194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.303291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 329/656] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:19.304361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.415135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.417486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4f7d-5ab1-4ae7-a9b1-fa6578a6be96 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.444440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc687d-5977-4182-9bdf-0d3f390dc4df None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.456064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.456812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.457189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.457766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.458423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:19.458794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.460323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.478608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 328/657] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:19.479659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.493055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.494242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.494707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.495176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.505366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.507670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:19.525181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:19.526067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:19.526948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 330/658] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:19.527421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.550869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.622688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925a5c-3ed8-4bf2-a441-c96245429ad8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.632812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830c09-ca5a-449b-a6fb-92ec9b6f1d9c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.664929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.666397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.666676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.667007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.673489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.674864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.675357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.675476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.676062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.676956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.685571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.687284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.690111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:19.693389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:19.694345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 15:14:19.695269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:19.698079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 329/659] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:19.699472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:19.703170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:19.704104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 15:14:19.705031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:19.707534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 331/660] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:19.712815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.816955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aec868-f7ed-41d0-af92-b61d660ca6d6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.831275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb668d-d6c9-484b-9f7f-71dcafbe39a1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:19.840694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:19.861258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.862099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.862383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.862661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.863755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:19.864068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.866242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.873201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:19.874163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:19.874711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:19.875181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:19.876366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:19.876919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:19.878550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:19.886232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 332/661] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:19.887487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.898783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 330/662] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:19.898783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:19.974223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.010446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213963-9612-41aa-9061-03918faf6840 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.020836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47967c42-0022-4bd5-a337-12814239a524 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.052775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.053453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.053739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.054049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.058009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.058699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.058983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.059259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.060113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:20.060422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.061921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.082182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 333/663] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:20.082952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.091964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.130412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.132127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.191579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af67ff9-7fae-4b60-a1cb-7b23eb72c97a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.209158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.228574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.229223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.229604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.229887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.230851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=bb8ca62c1d2e458d9831415740222bdd) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:20.231165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.232691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.239186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 334/664] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/role_assignments?user.id=bb8ca62c1d2e458d9831415740222bdd&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:20.239969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.240538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 331/665] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:20.251683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.355560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033992c-2276-4b81-a71b-4f7e70010122 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.379701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.396549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.397311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.397593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.398000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.418035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a079157-977f-4c34-8da7-06545ddf101a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.452299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.456339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.457146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.457428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.458008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.469019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.470508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.475164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.477325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:20.492625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:20.494137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:20.495009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:20.495009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:20.495009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:20.495009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:20.501924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 332/666] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:20.502211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.623837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c324584-c261-47ac-9266-033111244cd0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.630392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 335/667] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:20.635733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.642579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.671090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.671765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.672045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.672323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.673050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:20.673352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.674778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.703036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 333/668] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:20.708447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.760473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:20.782520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf1e6-a776-4ff4-8502-96f5f06bdba2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.825033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:20.825873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:20.826183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:20.826454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:20.843075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:20.844546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:20.862948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:20.863901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:20.864774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:20.864774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:20.864774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:20.864774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:20.864774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 336/669] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:20.869751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:20.929752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e81e-b5e6-41ca-84c0-1fdf903a2b15 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:20.975272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cbbf7-f34a-4790-a0f3-165f8ef5d536 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.005926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.013220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.013910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.014197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.014472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.015669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.016029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.017626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.019371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.020395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.020874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.026459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.031090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 337/670] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:21.034820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.036405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.036692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:21.050884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:21.051782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:21.052650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:21.055117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 334/671] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:21.064427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.132094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.139959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210bcb3-96c6-4c82-8d05-b4b51bc075a7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.175384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.176273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.176560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.176838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.184491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.185873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6282d6e3-882f-4aff-962d-c6b57fc86893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:21.200606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:21.201543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:21.202472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:21.206255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 338/672] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:21.206255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdcbd7-e9a6-4129-9aad-6a56b745cd72 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.206255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdcbd7-e9a6-4129-9aad-6a56b745cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.206255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdcbd7-e9a6-4129-9aad-6a56b745cd72 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.207436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 339/673] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:21.208605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484dc67-355b-47c6-be66-5e5630be736a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.208966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484dc67-355b-47c6-be66-5e5630be736a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.209340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484dc67-355b-47c6-be66-5e5630be736a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.211141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 340/674] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:21.212695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484dc67-355b-47c6-be66-5e5630be736a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.234297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebbc48-d350-4768-a6d1-94f18e5b1a6c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.272598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.272884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.273564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.273891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.274299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.275704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.276180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.277625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995656c-41c5-4c5a-8237-b1fe14ef5b83 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.291740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 335/675] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:21.291740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef389e3-a0a0-4faf-9306-a868185b2a2b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.291740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef389e3-a0a0-4faf-9306-a868185b2a2b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.291740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef389e3-a0a0-4faf-9306-a868185b2a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.309927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7ef389e3-a0a0-4faf-9306-a868185b2a2b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:21.311190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7ef389e3-a0a0-4faf-9306-a868185b2a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:21.333657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484dc67-355b-47c6-be66-5e5630be736a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.368676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.369379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.369651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.369926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.370708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.371015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.372441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.381280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 336/676] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:21.383198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.383484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.383760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.389255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 341/677] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:21.389944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.409144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:21.411313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:21.437373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.485955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 337/678] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:21.486789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.505528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6247-fd3e-4687-b75f-47e255f2e621 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.521479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.553460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.554240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.554520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.554787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.555607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=fa7ffb1028c44466a4192e0c17bb7df0) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.555947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.557378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.573936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 342/679] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/role_assignments?user.id=fa7ffb1028c44466a4192e0c17bb7df0&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:21.573936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.636825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e4e2-e34e-4015-aebd-d80a73a234fa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.688638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.689487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.689770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.690077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.691634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=9c21819f774b4052bced3ef15f6d83d0) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.691957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.694001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.697888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219efcf3-97c0-4f64-9a50-ba0575a0232e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.703627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 338/680] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/role_assignments?user.id=9c21819f774b4052bced3ef15f6d83d0&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:21.704604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.732965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.749581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.750578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.750971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.751330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.766067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:21.774452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:21.775759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:21.776645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:21.777760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 343/681] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:21.783504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.843716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:21.847092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c803d-75e6-4e23-b17b-8a92431397a8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.889436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.890831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.891286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.891788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.903814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:21.911921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:21.912859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:21.913682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:21.917283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 339/682] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:21.923407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:21.944990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684dd19-2bda-4916-b624-86ed34d3b8cc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:21.982545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:21.983221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:21.983502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:21.983778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:21.984564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:21.984827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:21.986256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:21.995664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 344/683] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:22.001158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.020698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.035281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0465-e08f-4da3-9eb0-f4462079dc9d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.075767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.076843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.077326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.077793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.078774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:22.079291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.080885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.091081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 340/684] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:22.099007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.119541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.124889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c30-19bc-4d71-8be2-fd2e8adc3f9b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.172760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.174026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.174531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.175014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.192513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.195175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:22.216597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:22.217531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:22.218431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:22.218431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:22.218431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:22.218431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:22.222208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 345/685] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:22.224014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.239940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec2bd-c683-4f73-8219-3e842cd31b94 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.277720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.278882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.279382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.279877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.298371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.307616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.311286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:22.334460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:22.335431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:22.336313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:22.336313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:22.336313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:22.336313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:22.338619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 341/686] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:22.345829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.348104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3c52d-8e8b-4906-a5da-9abd1f6084f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.388155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.388823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.389094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.389370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.390651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:22.390964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.392489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.407848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 346/687] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:22.413142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.427463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.534645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2aea-4fe8-4fa5-b121-de31e9964846 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.534884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fcd8-a52d-4461-86dd-94468e4fe85f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.569114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.569885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.570200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.570482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.571212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:22.571660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.573252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.577666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.578490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.578772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.579046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.585801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 342/688] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:22.594959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.596141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.597615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:22.624776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:22.625778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:22.626740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:22.638379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 347/689] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:22.646880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.678334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.721227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa2d9-8fb3-4b40-ad85-1fec27921c92 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.741695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.756357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.757155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.757444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.757723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.766820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.768781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.781169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77112d52-5bc1-4502-ab85-65245be17341 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8c637e38-ac0d-4bd0-a211-e1e57c70014b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:22.786784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:22.787698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:22.788631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:22.793334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 343/690] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:22.794701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceac73-ea88-4ca6-bfb7-6ff15a183291 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.794986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceac73-ea88-4ca6-bfb7-6ff15a183291 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.795264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceac73-ea88-4ca6-bfb7-6ff15a183291 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.797552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 344/691] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:22.797552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceac73-ea88-4ca6-bfb7-6ff15a183291 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.830943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.832015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.832447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.833200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.834498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:22.834970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.837822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e1848-494c-4356-99a4-321926fbaad9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:22.858787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 348/692] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:22.860370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.860796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.861203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.881726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:22.883683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:22.929965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceac73-ea88-4ca6-bfb7-6ff15a183291 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:22.951760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:22.974004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 349/693] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:22.974996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:22.975363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:22.975670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:22.976112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:22.976375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:22.977219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:22.977525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:22.982647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.007589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 345/694] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:23.008562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.059956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.113549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb725-d535-4181-bdac-ab29c7390bc9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.129706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44d5d-9f88-4f3f-a76f-28b47831ae34 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.156500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.157574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.158442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.159244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.170358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.171168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.171442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.171709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.172354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.174124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:23.192418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:23.193390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:23.194314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:23.197979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 346/695] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:23.199234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.250297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.250774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.253110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.334508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa75ed-095e-4b69-a878-ef1644990aa4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.335626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.380971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.381631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.381938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.382240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.401833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 350/696] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:23.404236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.472341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.474209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.530874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.532691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b751fa-3044-4751-8e44-32bae058d010 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.572115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.573171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.573715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.574224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.575224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:23.575928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.577600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.583034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 351/697] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:23.584134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.605833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 347/698] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 15:14:23.606706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.612475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.693773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d4f96-d62b-476f-aa67-f2c45a6bb315 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.712663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab09034-60a2-4bb3-ae17-38a224a1f694 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.731667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.732787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.733276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.733890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.745769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.747566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.748341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.749097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.749376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.749648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.750509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:23.750782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.752252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.766220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 348/699] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:23.767223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:23.768772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:23.769616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:23.770529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:23.770529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:23.770529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:23.770529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:23.771451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.774080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 352/700] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:23.785950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.880622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:23.910874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5689-f224-4eab-8bbb-a6f9f996047a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.934163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474f497-5c4f-4f49-a086-90980be43ce3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:23.950420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.951296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.951732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.952092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.952922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:23.953329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.955101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb557-3d93-4a90-9cf5-a650e02bc38f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:23.970157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 353/701] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:23.971701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa3680-9e30-4969-a40d-fb5cab410636 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.972091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa3680-9e30-4969-a40d-fb5cab410636 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.972471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa3680-9e30-4969-a40d-fb5cab410636 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.974091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 354/702] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:23.975401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa3680-9e30-4969-a40d-fb5cab410636 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:23.978011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:23.979217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:23.979784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:23.980309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:23.994259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:23.995924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c0a1fc09-d7e4-41b4-86b4-8d70661935c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:24.015018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:24.016268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:24.017182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:24.017182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:24.017182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:24.017182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:24.017182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 349/703] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:24.017777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.017945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.018273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.042018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:24.044142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:24.097334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.115970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa3680-9e30-4969-a40d-fb5cab410636 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.117249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 350/704] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:24.121941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.173082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.173936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.174324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.174695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.177207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.186391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.188161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:24.206036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:24.207054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 355/705] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:24.208574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.247696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044ba2d-ae40-4a7c-8714-a1a32b7d6a50 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.285373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.286540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.287029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.287520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.288519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.289028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.291222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.313780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 351/706] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.313780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.315311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828000-c728-41de-b3bc-d66a11720af7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.349331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.350222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.350500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.350768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.351414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.353308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.358962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:24.367173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:24.368171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:24.369559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:24.374165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 356/707] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:24.375425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.420419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dbd31-a62c-4ea9-97c2-daa00f955c86 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.439942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.455823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.456476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.456756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.457028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.457794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.458125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.459528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9f7f-9514-4367-9e90-b16041e53f2e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 352/708] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685528-4d16-4fbc-818f-6e0b756cf275 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685528-4d16-4fbc-818f-6e0b756cf275 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685528-4d16-4fbc-818f-6e0b756cf275 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 353/709] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:24.476906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685528-4d16-4fbc-818f-6e0b756cf275 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.493152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affadc1-a3d3-4b02-a6fc-0490c48b7b1c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.530315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.531209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.531845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.531845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.539151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.540865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:24.556300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:24.557203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:24.558108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 357/710] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:24.558595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.593834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685528-4d16-4fbc-818f-6e0b756cf275 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.597482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.631754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.632825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.632825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.633019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.633649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] RBAC: Adding query filter params (name=network) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.634492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.635844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2de9-d7a5-4b4c-81f0-c3f0e1bec498 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.646014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 354/711] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.646014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.646014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.646014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.661958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:24.663118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:24.668982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c250-bc04-43a7-80c4-a34279c354c7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.687486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.705258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.705932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.706217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.706494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.707322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=530cf69a596d42eeb576903bb39816cc) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.707882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.709058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.721950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 358/712] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/role_assignments?user.id=530cf69a596d42eeb576903bb39816cc&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.721950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.747280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 355/713] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:24.748284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.852067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d717a9-c1c7-4683-897c-484beccce7f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.877444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:24.882356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3c1fb-5a0e-4530-b191-45ab40787914 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:24.890958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.891627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.891909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.892182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.892973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.893279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.894850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.908634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 359/714] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.909370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.931698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:24.932249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:24.932589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:24.932834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:24.933695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] RBAC: Adding query filter params (type=network) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:24.933925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:24.935364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:24.940977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 356/715] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:24.941767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:24.975275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:25.056405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059180ef-e5c5-4a4a-acbe-a9cd5dff5a04 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:25.070130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576ef80-7c9f-497b-b560-a4308c1a4ecf None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:25.102009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:25.104231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:25.104673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:25.105175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:25.116824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:25.116824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:25.117300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:25.117665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:25.119233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:25.119618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:25.120284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:25.121923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:25.122830 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:25.133637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 357/716] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:25.142525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:25.143503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:25.144401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:25.144401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:25.144401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:25.144401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:25.144401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:25.150049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:25.205441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:25.261402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309c99-03b5-492c-a392-2df7cf5e1f01 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:25.309552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:25.310349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:25.310634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:25.310906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:25.311641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:25.311942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:25.313331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4b82c-8154-46a3-b4b8-5ddd54285c75 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:25.327071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 358/718] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:25.335014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:25.463711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:25.470850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf1ab-d112-4e2e-954e-cbdd7259bfaa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:25.507631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:25.508299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:25.508580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:25.508883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:25.509588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:25.511058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef8f43-a5d4-44d0-9622-b34598867ccd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:25.546911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 361/719] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:14:25 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:26.119406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beaf2-bfa1-4491-bf82-f99fb6ac7a54 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:26.119951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beaf2-bfa1-4491-bf82-f99fb6ac7a54 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:26.119951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371beaf2-bfa1-4491-bf82-f99fb6ac7a54 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:26.121571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 359/720] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:26.127141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9828-7c52-4d5f-b2f9-1c0e6301c7b7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:26.127434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9828-7c52-4d5f-b2f9-1c0e6301c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:26.127712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9828-7c52-4d5f-b2f9-1c0e6301c7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:26.146652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-42ad9828-7c52-4d5f-b2f9-1c0e6301c7b7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:26.147832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-42ad9828-7c52-4d5f-b2f9-1c0e6301c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:26.229028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 362/721] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:14:26.275400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371beaf2-bfa1-4491-bf82-f99fb6ac7a54 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:26.391177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:26.419530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371beaf2-bfa1-4491-bf82-f99fb6ac7a54 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:26.462589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:26.463254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:26.463531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:26.463801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:26.464522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:26.465932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d34d4-a0ce-490e-8b28-4b4c5db88b98 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:26.499763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 360/722] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:26 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:27.301981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77b08-252b-40b1-8e9d-fdf476c0cc82 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.302530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77b08-252b-40b1-8e9d-fdf476c0cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.302530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77b08-252b-40b1-8e9d-fdf476c0cc82 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.304167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 363/723] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:27.309485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.309935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.310140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.339653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:27.340847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:27.448033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387074-4af1-4e8e-850b-500ae45aed2c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.448378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387074-4af1-4e8e-850b-500ae45aed2c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.448590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387074-4af1-4e8e-850b-500ae45aed2c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.451348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 364/724] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:27.455318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 361/725] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:27.455734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309bd31-7975-49a6-94f9-de8f4cb69d76 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.456030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309bd31-7975-49a6-94f9-de8f4cb69d76 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.456437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309bd31-7975-49a6-94f9-de8f4cb69d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.473370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f309bd31-7975-49a6-94f9-de8f4cb69d76 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:27.474572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f309bd31-7975-49a6-94f9-de8f4cb69d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:27.487946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:27.585085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 365/726] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 15:14:27.587777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697df2-04ee-4fbc-8b90-f187cd94446b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.588267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697df2-04ee-4fbc-8b90-f187cd94446b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.588752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697df2-04ee-4fbc-8b90-f187cd94446b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.590490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 366/727] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:27.599313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.599456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.600386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.620764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:27.622006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:27.622118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:27.626633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:27.660777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eef49-4f86-49f6-a460-57f70efac366 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:27.709961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 367/728] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 15:14:27.710904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:27.817367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45506e9-f438-48a1-8d01-903c7e51b148 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:27.844276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:27.844878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.845427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.845703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.846453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:27.848475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:27.859940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:27.861173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:27.861556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:27.862071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:27.870013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 362/729] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:27 2022] POST /identity/v3/services => generated 240 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:27.871066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:27.879140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:27.885074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:27.895910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:27.897014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:27.898369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 368/730] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:27.905873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.088395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb9b1-9afd-4f2f-b113-925854b739e7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.104918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bf40a-81ac-4820-bf7e-2b12fa0181af None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.122398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.132554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.134133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.134608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.135066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.145867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.146594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.146880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.147155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.147911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:28.148214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.148603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:28.149631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:28.157464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:28.159476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:28.160734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:28.161511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 369/731] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:28.161595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 363/732] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:28.164635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.168656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.242286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.285338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7bc0-6ff8-443d-aefd-cb7f33ef75c9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.291734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1cca5-b3e4-42c0-bad6-2ea8a3143b9a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.326145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.327617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.328046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.328588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.333918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.335169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.335594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.336008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.337370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:28.337836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.339758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.340934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.342713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.349690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 370/733] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:28.355983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:28.365810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:28.366723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:28.367605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:28.367605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:28.367605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:28.367605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:28.367605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 364/734] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:28.375446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.453435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.463888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654cff-6e8c-4f3d-90b2-647135ad370e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.488996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.509092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.510298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.510781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.511277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.523260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.525732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.535737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ab9fd-4c23-4fdd-adda-8277560eda1a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-88e00c9d-3af7-4a9a-bf72-cd0e714afaf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:28.544537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:28.545427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:28.546342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:28.546342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:28.546342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:28.546342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:28.552811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 371/735] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:28.554422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667791a6-5385-4266-9439-e4b9e26f8478 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.554924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667791a6-5385-4266-9439-e4b9e26f8478 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.555426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667791a6-5385-4266-9439-e4b9e26f8478 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.557184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 372/736] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:28.558093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667791a6-5385-4266-9439-e4b9e26f8478 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.572633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.573359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.573643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.573942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.574847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:28.575155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.576582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109ef4b-4523-421a-be40-7e13d65001ff None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.590084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 365/737] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:28.591531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.591821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.592081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.610665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:28.611886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:28.683365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667791a6-5385-4266-9439-e4b9e26f8478 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.689926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 366/738] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:28.689926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.733707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.743689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.744668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.745150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.745621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.746962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:28.747493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.749727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.766384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 373/739] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:28.767494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.808786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:28.825860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb3408-b1ce-4bb1-a0ab-0dd5b04420af None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.869800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.870598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.870881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.871262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.878856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:28.880316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:28.887595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8cda-69da-4fa0-a8cc-5e89ccfed2b0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:28.896414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:28.897368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:28.898318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 367/740] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:28.898907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:28.935172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:28.937335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:28.937768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:28.938226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:28.954443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:28.966218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:28.967327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:28.968358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:28.975813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 374/741] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:28.975813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.003671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.017535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d88d2-2a32-4feb-a9b5-6c5b1207a298 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.052776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.053569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.053855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.054155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.061943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.063399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:29.077751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:29.078915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 368/742] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:29.079843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.094225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.100501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824060f-e78c-4a79-95a3-71d2d216662a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.133549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.134764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.134981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.135239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.136084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:29.136384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.137817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef1e75-7e69-4e1d-8bdc-4d309e89c018 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 375/743] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846519-944e-4dcb-a3b2-9c94b75e5e38 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846519-944e-4dcb-a3b2-9c94b75e5e38 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846519-944e-4dcb-a3b2-9c94b75e5e38 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 376/744] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:29.162119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846519-944e-4dcb-a3b2-9c94b75e5e38 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.198440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca62b-1237-4751-b8d0-1ccf132770c7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.233215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.233885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.234192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.234470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.235217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:29.235523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.236877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.245579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 369/745] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:29.246721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.262288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.276000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846519-944e-4dcb-a3b2-9c94b75e5e38 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.311749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.312432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.312710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.312983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.313825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:29.314161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.315591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7e8f-d2eb-4f14-8044-101518e8ac14 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.335612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 377/746] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:29.337064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.337371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.337643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.353820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:29.355022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:29.363050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.364148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dada451-01f5-4729-9ddf-fea9f1dff8e0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.401612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.402216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.402497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.402773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.433926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 378/747] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:29.433926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.484105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.485538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.499143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.537382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcda33-89f1-470d-b9b7-103f01167091 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.586179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.587000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.587280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.587549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.596801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 370/748] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:29.596801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.601195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.603242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.605142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:29.623418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:29.624331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:29.625290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:29.625290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:29.625290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.625290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:29.625290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 379/749] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:29.626515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.706870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e85494-06a6-4e67-95bf-839d2b211f45 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.721423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.728990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914010c4-4310-4778-9826-a7ed171b1d21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.746236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.747028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.747307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.747717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.757749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.759260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.765656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.766493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.766778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.767053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.767727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.769098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:29.779790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:29.780666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:29.781540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:29.781540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:29.781540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.781540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:29.781540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 371/750] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:29.782392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:29.785913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:29.786993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:29.787804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 380/751] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:29.793097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.856983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:29.891580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13079e-2253-4d6a-9aa1-f754ea786cfd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.901778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35657aa-1f44-41cf-87aa-e52baa044581 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:29.929980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.930801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.931085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.931365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.936477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:29.937251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:29.937543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:29.937822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:29.939097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:29.939413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.941190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.941757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:29.943203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:29.957403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 381/752] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:29.957403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:29.960676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:29.961567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 372/753] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:29.963288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:29.988425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.067067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f161-c73e-40c6-85f1-f6a55d3c9924 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.085166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.095883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69af10f-776e-4bda-b34f-6ab2563f332b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.105017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.105945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.106074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.106263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.106988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.107297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.108676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.120529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 382/754] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.121331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.138290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.138957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.139264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.139538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.140505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.140807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.142186 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.151417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 373/755] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.151417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.235394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.235789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ac38-58c8-4f0a-ab2b-6567ad8d453d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.256058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c1c2c-be3c-4840-969c-20740961ccae None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.269728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.270562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.270847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.271127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.279060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.280494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.290780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.291445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.291731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.292010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.292732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.293038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.294444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:30.295038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:30.295909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:30.296899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 383/756] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:30.297470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.309131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 374/757] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.310127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.341698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.401441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5461-1c25-4667-bfde-d44c7a00ed5f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.414821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53755a8-7067-463c-aa69-42f542db42c6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.433491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.434309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.434591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.434865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.441439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.442918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.447710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.448364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.448641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.448996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.449602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.449916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.451290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9a9b-b3c7-49e9-9ece-e7974cbd4fb7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.455889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 375/758] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.457045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7318-8cba-491e-afe9-7dc2c45019d4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:30.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:30.457968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:30.463947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:30.464395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7318-8cba-491e-afe9-7dc2c45019d4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.464395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7318-8cba-491e-afe9-7dc2c45019d4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.464547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 384/759] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:30.464547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.464692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 376/760] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:30.464692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7318-8cba-491e-afe9-7dc2c45019d4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.466995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.556060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.560016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eade0-1f02-41cc-9180-8d1dde9338be None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.562310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7318-8cba-491e-afe9-7dc2c45019d4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.593638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.594327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.594615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.594892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.595730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.596037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.596450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.597230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.597473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.597564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.597768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.604345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.605760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.614268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 385/761] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.615055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b2cbbf6f-38cf-494b-b47a-fb75ebe57c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:30.619236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:30.620261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 377/762] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.626045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.626769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.638556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:30.639721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:30.697586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.705683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 378/763] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:30.706515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.716502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b917039-6533-4f37-ba94-a56cc9b99faf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.755165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.755822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.756111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.756391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.757171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] RBAC: Adding query filter params (interface=public, service_id=1b3011817a8b4ff6a03ac46013e79f91, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.757482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.759547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.766985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 386/764] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/endpoints?service_id=1b3011817a8b4ff6a03ac46013e79f91&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.767807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.789075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.820626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0daa74-f7e6-4893-a104-f4d5b1028a77 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.853759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.854474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.854756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.855033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.855817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:30.856124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.857536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.865278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271da4a-0044-4ea3-aef5-89d930a461f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.869298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 379/765] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:30.870097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:30.899268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:30.899936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:30.900216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:30.900490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:30.925632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:30.966598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:30.968053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:30.970465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702f2b-11ec-422e-b83b-607709e56621 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:30.987814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.002999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.003647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.003930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.004206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.004980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.005284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.006794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.020879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 380/766] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:31.021804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.067301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 387/767] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:31.068124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.119134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d2e0-7303-406a-9cc3-b0b71e750660 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.132727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.152888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.153672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.153982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.154255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] PATH_INFO: `/v3/services/network` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.154900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.156254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.163941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eb61-8f41-4d86-a861-4d953160a8fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:31.168177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:31.169234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:31.170089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 381/768] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:31.170879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.184761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.198898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.199562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.199846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.200124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.200807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.202197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.207139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 388/769] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/services => generated 772 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:31.208400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.303445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21e35-5c34-4f73-a516-63529fb8a050 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.324996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906eeef4-8861-47f5-b4e0-97d403314714 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.340636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.341570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.341846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.342150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.344182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=92191aff46eb4e98b5923c3ad95a8012, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.345649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.362867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 382/770] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:31 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:31.363711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.363823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.365025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.365304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.365575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.366438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=530cf69a596d42eeb576903bb39816cc) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.366751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.369666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.381958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 389/771] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/role_assignments?user.id=530cf69a596d42eeb576903bb39816cc&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:31.381958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.441781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.456266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.516749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18df9f-0511-428c-acc2-bd23d088c112 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.528218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6fe5-0a03-485c-8a6a-188880df3f09 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.556294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.556972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.557253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.557521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.558301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] RBAC: Adding query filter params (name=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.558572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.560054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.565739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 390/772] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:31.571117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.573827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.575075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.575520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.576098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.588149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.589942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:31.612249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:31.613175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:31.615317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:31.615317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:31.615317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:31.615317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:31.617434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 383/773] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:31.624073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.705439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62a71-1a40-4a6f-9884-d741354ace84 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.722657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.733749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:31.745477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42ff1-04a1-4117-a7b2-54b041982086 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.754265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.754941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.755222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.755501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.756206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] RBAC: Adding query filter params (type=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.756510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.758368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.768288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 391/774] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:31.773683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.819322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.820421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.820962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.821520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.822500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.823014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.824644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.853120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 384/775] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:31.858959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:31.902455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a020-2566-4100-886f-3ff469c41afd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:31.943796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:31.944463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:31.944761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:31.945042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:31.949613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] RBAC: Adding query filter params (interface=public, service_id=393b6afedc914823ac5457727424f692, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:31.949613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:31.949613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:31.954099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 392/776] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/endpoints?service_id=393b6afedc914823ac5457727424f692&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:31.959062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:32.012821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:32.047983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fe502-dd38-498e-b19e-3f871baf4f08 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:32.103114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:32.104564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:32.105080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:32.105565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:32.113482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:32.115511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:32.131965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:32.132862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:32.133765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:32.136569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 385/777] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:32.143184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:32.146044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6293b-912b-4203-a919-594b32f23e26 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:32.166330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:32.211509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:32.212731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:32.213011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:32.213283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:32.213993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:32.215429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:32.225437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 393/778] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:31 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:32.311822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b44f3-6b6c-47ec-af5a-b3bd2a840eca None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:32.347783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:32.348453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:32.348728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:32.348996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:32.349784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:32.350115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:32.351550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41804a1-7332-41a6-9123-30cc91b69247 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:32.373688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 386/779] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:32.379699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:32.499512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf605a3-0d6a-413b-bb0c-bc5a412c72c1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:32.502223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:32.536778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:32.537429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:32.537708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:32.538008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:32.538835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=71223c29d15c41f8b5e0ec738b7b327c) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:32.539143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:32.540614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2df41-1d20-478c-811d-10955a3bcdd1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:32.546726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 394/780] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:32 2022] GET /identity/v3/role_assignments?user.id=71223c29d15c41f8b5e0ec738b7b327c&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:33.674209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c008-eb57-47f8-b4eb-188a0755d434 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:33.674707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c008-eb57-47f8-b4eb-188a0755d434 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:33.674707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c008-eb57-47f8-b4eb-188a0755d434 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:33.676439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 387/781] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:33.681818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:33.682251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:33.682421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:33.840705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:33.841885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:33.929129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6a2-6f9f-4c48-8068-97f415cf397c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:33.929375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6a2-6f9f-4c48-8068-97f415cf397c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:33.929606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6a2-6f9f-4c48-8068-97f415cf397c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:33.931377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 388/782] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:33.935231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 395/783] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:33.947696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35ee1-4104-4760-8c9c-c20823540881 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:33.948005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35ee1-4104-4760-8c9c-c20823540881 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:33.948419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35ee1-4104-4760-8c9c-c20823540881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:33.975116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-47e35ee1-4104-4760-8c9c-c20823540881 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:33.976366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-47e35ee1-4104-4760-8c9c-c20823540881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:33.983009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.074700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.081503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 389/784] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:34.082945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8df-50f1-4825-b8de-b09579240c9c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.083229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8df-50f1-4825-b8de-b09579240c9c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.083504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ae8df-50f1-4825-b8de-b09579240c9c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.089974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 390/785] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:34.092629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.092910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.093182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.112868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.117109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24df9-6f98-4bf7-8a8e-848975257043 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.119252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:34.120578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:34.154069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.155183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.155665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.156163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.157010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.158604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:34.171513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:34.172415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 15:14:34.173227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:34.181054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 396/786] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 15:14:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:34.182134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.197959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 391/787] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:34.197959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.302978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648de7a-9dd0-405d-be2f-901d996a8357 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.335079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.336565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0f46-7e09-41b1-8fa0-e155e7309faa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.342042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.342712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.342992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.343269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.344253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:34.345035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.347081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.356871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 392/788] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:34.356871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.389181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.390517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.390967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.391634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.406518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:34.416932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:34.418101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:34.419135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:34.426959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 397/789] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:34.426959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.453918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.487003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec6b94-bfaa-4909-8233-5fdb5afc483b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.532937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74ffc2-9f05-420e-8581-0551166298d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.536781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.537816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.538333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.538819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.553597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:34.565585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:34.566572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:34.567408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:34.575182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.575182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.575182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.575182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.575626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:34.575626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.575820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 393/790] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:34.576840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.577431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.585949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 398/791] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:34.585949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.664680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.680130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.698655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91b2a-62db-41aa-9bff-97b47b09cd88 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.728986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f885e0-6734-427d-b86a-7c1a883b9e66 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.733599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.734413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.734790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.735156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.735999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:34.736396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.737871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.747687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 399/792] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:34.749205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.780567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.782128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.782564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.783257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.784402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:34.784897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.787081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.803211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 394/793] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:34.804393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.865134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8a65-f0e2-402b-92cd-00c0bc31132f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.912835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.914363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.914993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.915452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.916858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.918887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:34.922044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746e16-a57c-4d80-8061-60764276e284 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:34.940158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.944148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 400/794] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:14:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:34.945653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:34.959800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:34.967563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:34.969411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:34.969661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:34.969952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:34.985131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:34.986564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e0b2d816-be1e-4b48-a20f-67da63fb90c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:35.005370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.006412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.007371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:35.007371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:35.007371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:35.007371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:35.010080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 395/795] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.011872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3a76-1720-4737-b84a-89c664689aaa None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.012401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3a76-1720-4737-b84a-89c664689aaa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.012898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3a76-1720-4737-b84a-89c664689aaa None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.014732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 396/796] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:35.016315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa5d7-d348-47ec-97b3-9567af485a21 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.016668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa5d7-d348-47ec-97b3-9567af485a21 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.017016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa5d7-d348-47ec-97b3-9567af485a21 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.018512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 397/797] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:35.023414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa5d7-d348-47ec-97b3-9567af485a21 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.090201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fcf4c-0d0a-466b-b025-577637f31c03 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.128591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.129673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.129673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.130058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.142591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa5d7-d348-47ec-97b3-9567af485a21 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.144694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.145699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-803ea442-d144-4f32-8cab-7eb35b3452fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:35.163874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.164841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.166333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:35.166333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:35.166333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:35.166333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:35.166333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 401/798] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.171856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.171856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.171856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.184245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:35.185408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:35.190920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.191585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.191863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.192131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.193257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:35.193562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.195326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377974c-904f-4633-95d1-cb40783409e3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.207885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 398/799] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:35.213759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.214070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.214345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.231503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:35.232676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:35.237867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.253412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.255239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 402/800] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:35.255861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.326109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 399/801] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:35.326109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.362569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda61c-c216-40a0-8c3f-7378f0ce1a59 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.403055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.403720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.403996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.404266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.404986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:35.405312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.406700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.419038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 403/802] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:35.419668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.442374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3705-e8f6-4deb-96cb-822c9c649e1a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.467951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.479324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.480121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.480402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.480677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.488141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.489515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:35.504718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.505855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 400/803] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.506813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.523654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.533947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff00d8e-27a6-4fa1-b42d-91ee79556869 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.573177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.573995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.574389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.574665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.575343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.576777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.589282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.590350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 15:14:35.591197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:35.597504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 404/804] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.597504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.616573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254dd9-bfae-451b-b088-1ce4f78fd07b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.653098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.653893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.654199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.654475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.665730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:35.673916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.674885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:35.675758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 401/805] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.676472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.708090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43d6b-744b-402f-8e68-f44c37618ad6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.719668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.745250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.746000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.746285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.746556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.754317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.755787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.756259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:35.770772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:35.771715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:35.772647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 405/806] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:35.773708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.789077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269c9d-d50a-476a-ae1f-fb7a5a904cd9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.825389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.826091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.826453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.826705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.827488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:35.827787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.829217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.850957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 402/807] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:35.850957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.886302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e57e0-1fdd-429b-90d4-a8b7a255c98b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.922395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.923056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.923337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.923610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.924303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] RBAC: Adding query filter params (name=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:35.924601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:35.925972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:35.935486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 406/808] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:35.935486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:35.958470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83c3b-4bb4-45f1-b25f-c90030d0e485 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:35.971601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.990566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:35.996877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:35.997487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:35.997774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:35.998082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:35.998837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:35.999144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.000516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.010163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 403/809] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:36.011356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.050584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d24f85-54f2-4c24-a9d2-0f0b7a289fce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.090746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.091425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.091702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.091973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.092811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:36.093116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.094576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.112131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 407/810] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:36.115084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d408eb-6b78-45b4-93ec-401802d7d6d0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.117253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.152627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.153276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.153555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.153828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.209760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.218958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.220693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b839c1-1d6f-4946-8368-a5a8210f4f89 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.227058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.228529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.260007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.260721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.261106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.261507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.262337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:36.262741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.264192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.273790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 408/811] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:36.273790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.344111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 404/812] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:36.345229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.388598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf201f-1b3a-4bdf-8753-43a9ff4c4fa0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.424097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.424895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.425175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.425799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.437786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.439390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.442787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.450827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06103cb5-308f-4c9c-9c0a-01440ad118d9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:36.457188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:36.458284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:36.459337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:36.459337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:36.459337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.459337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:36.459337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 409/813] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:36.460316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.471076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.490409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.491204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.491675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.491787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.503618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.505361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:36.524371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:36.525249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:36.526206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:36.526206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:36.526206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.526206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:36.526206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 405/814] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:36.526486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.578584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7441cc-3a4f-45d2-9c5d-ea05cb52b657 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.615837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.616523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.616808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.617086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.617825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.619807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.639165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4006-cbe8-4461-b7ed-b99ad01f2c88 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.650134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 410/815] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:14:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:36.650134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.691118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.691955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.692231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.692498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.704264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.705805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.708195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:36.727182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:36.728909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:36.729962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:36.729962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:36.729962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:36.729962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:36.729962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 406/816] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:36.730399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.747353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:36.811378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c665b5-2a55-4d9b-a74d-3979d6bccfc1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.855352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c47973-5012-4a3e-ade2-4887f675845b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:36.860509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.861177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.861458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.861728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.862481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:36.862780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.864561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.884028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 411/817] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:36.884960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.902481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:36.903463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:36.903912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:36.904337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:36.905215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:36.905670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:36.907284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:36.920943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 407/818] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:36.921681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:36.982662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.001931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fbdd-11f2-4daf-905f-7c6fa3822d24 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.026515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.030412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf121-cb22-4f0d-a302-ab13fe51f350 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.038557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.039214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.039498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.039772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.041020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:37.041325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.042712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.054597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 412/819] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:37.055384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.065387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.066163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.066447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.066718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.074277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.075731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-459b0a89-62fe-4b7b-866b-8dc72c4487c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:37.090063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:37.090971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:37.091884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 408/820] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:37.092484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1285cc-21f9-43ec-86b9-ed24d8a762b9 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.093047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1285cc-21f9-43ec-86b9-ed24d8a762b9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.093047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1285cc-21f9-43ec-86b9-ed24d8a762b9 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.094332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 409/821] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:37.094869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1285cc-21f9-43ec-86b9-ed24d8a762b9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.155045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bacefc-bb41-4a38-bd09-157f46d48f83 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.187115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.187892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.188176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.188450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.195027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.197040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.198008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1285cc-21f9-43ec-86b9-ed24d8a762b9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:37.210800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:37.212519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:37.213514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:37.214073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.214570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 413/822] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:37.214570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.234544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.235333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.235619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.235918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.242844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.248299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.260010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-957a4e98-bbf8-4d6f-8008-f7fb77f0068c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:37.262658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:37.263644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:37.264721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 410/823] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:37.265555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.265555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.265775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.282687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:37.283890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:37.320971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe387bd1-5273-4504-87bd-1f1ec158901e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.349407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 411/824] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:37.350387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.355329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.355994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.356276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.356550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.357381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:37.357735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.359195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.376530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 414/825] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:37.377325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.448660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56442-2e57-451b-a284-1cbd88f510d5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.450947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.475621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d8e6-57a6-4f45-9fe7-c85ddd7aec13 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.477110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.482387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.483039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.483314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.483580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.484352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:37.484650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.486109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.497943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 412/826] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:37.498524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.513762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.514443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.514724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.514996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.516024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:37.516329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.517735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.528886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 415/827] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:37.529654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.608027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9d878-6168-40f5-ba50-37c9c7238bc7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.625615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e3e34-3d0a-48a5-803f-731f7f4ed70d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.642078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.642878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.643154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.643423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.644061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.645416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:37.656902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:37.657951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:37.658779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 413/828] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:37.659541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.660365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.661147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.661426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.661695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.672293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.673712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.687783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:37.691329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:37.692271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:37.693160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:37.693160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:37.693160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:37.693160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:37.693160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 416/829] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:37.693440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.709611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.763450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94175-4997-4968-bb8f-5ba295a8a217 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.792022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360b434-2cc1-43dc-80cf-42430673e27b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.796583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.797540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.797887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.798188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/530cf69a596d42eeb576903bb39816cc/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.800113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=530cf69a596d42eeb576903bb39816cc, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.801540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.814434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 414/830] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:37 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/530cf69a596d42eeb576903bb39816cc/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:37.815203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.828493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:37.830207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:37.830498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:37.830777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:37.831640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:37.831955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:37.833448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:37.851962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 417/831] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:37.851962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:37.953720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.962779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:37.983292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a64f9-3595-447d-9d56-fb7b80d02bff None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:37.990075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e95955-521a-4fa2-8233-9a89b9b32dd9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:38.031929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.032254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.032599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.032879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.033004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.033160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.033254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.033437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.033862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:38.034174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:38.034287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.034479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.035600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.035834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.044347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 415/832] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:38.049454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:38.050534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 418/833] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:38.056957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:38.183236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8062-590d-4e46-b8b5-ad6a76887b67 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:38.183464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741ed2-5929-4017-bebe-cb173a03437a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:38.226589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.226784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.227346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.228139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.228414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.228918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.229551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.230055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.231146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:38.231941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.233498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.236508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.238401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.239976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 416/834] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:38.255098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:38.256079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:38.256970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:38.259358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 419/835] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:38.259697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:38.267584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:38.293208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:38.397292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29a4d-a0fd-4802-b59a-b4eb48f03181 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:38.433180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.433852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.434163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.434436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.435221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:38.435526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.436951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da481223-5da1-48a8-bd36-cc2e90d0feab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.449557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 417/836] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:38.455401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:38.567225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af27a-524b-418e-831f-5aff02856050 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:38.603108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:38.603999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:38.604280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:38.604556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/71223c29d15c41f8b5e0ec738b7b327c/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:38.619733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=71223c29d15c41f8b5e0ec738b7b327c, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:38.621197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1a281-45b7-4d9b-84cb-3e6161398633 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:38.636955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 420/837] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:38 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/71223c29d15c41f8b5e0ec738b7b327c/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:14:39.873353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9c5-d4dc-45d1-a7cd-26d2c1258084 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:39.873918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9c5-d4dc-45d1-a7cd-26d2c1258084 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:39.873918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b9c5-d4dc-45d1-a7cd-26d2c1258084 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:39.875537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 418/838] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:39.880691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1863-7185-4370-ba44-b090b455b2f5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:39.881091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1863-7185-4370-ba44-b090b455b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:39.881232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1863-7185-4370-ba44-b090b455b2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:39.898985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-185e1863-7185-4370-ba44-b090b455b2f5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:39.900192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-185e1863-7185-4370-ba44-b090b455b2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:39.945781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:39.971032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 421/839] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:39.985869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad11d4-9c31-4a61-85dd-adf24873beb5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:39.986208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad11d4-9c31-4a61-85dd-adf24873beb5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:39.986488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad11d4-9c31-4a61-85dd-adf24873beb5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:39.988090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 419/840] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:39.993735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:39.994060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:39.994342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:39.994572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad11d4-9c31-4a61-85dd-adf24873beb5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.011353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:40.012636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:40.086444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.093981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 422/841] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:40.116083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.123104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad11d4-9c31-4a61-85dd-adf24873beb5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.170111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.171676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.172181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.172659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.187120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:40.197089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:40.198074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:14:40.198925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:40.199551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 420/842] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:40.205409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.233272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ecd62-e32c-4c23-b606-5b38d0cbf8ef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.246676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.278222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.279575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.280506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.280968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.282100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.284576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:40.300448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:40.301512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:40.302371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:40.310426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 423/843] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:40.313693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.322472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516e702-8870-4712-b49b-41d2e2044feb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.367461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.368586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.369020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.369785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.370992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:40.371476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.373458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.376077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.386212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 421/844] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:40.391970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.440282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf60c3b-0cc8-4dda-8259-f0b5dd7676f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.478309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.479132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.479418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.479692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.480807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:40.481071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.482455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0077f-a4f4-463e-9a37-4cf883500894 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.491458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 424/845] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:40.491458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653019-a810-4c59-a904-85e2def11108 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.491458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653019-a810-4c59-a904-85e2def11108 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.491458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653019-a810-4c59-a904-85e2def11108 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.491458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 425/846] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:40.495578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653019-a810-4c59-a904-85e2def11108 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.503802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f1e-d73f-4b5e-890d-23528ed1133d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.534847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.541544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.542373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.543020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.543301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.554523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.556716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-612b1861-f68a-4531-a359-1351d217f565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:40.574796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:40.575712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 422/847] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.581435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.594904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:40.596084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:40.609254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653019-a810-4c59-a904-85e2def11108 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.645253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.645934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.646235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.646510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.647203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:40.647507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.648032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.649263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.654499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 426/848] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:40.655302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.675254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 423/849] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:40.698929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.782403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.785541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe034-bd57-4572-9b16-fb7687cf8722 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.821326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8214f-1a4c-4774-bff7-3f88b66bfd28 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:40.828659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.829753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.830105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.830385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.831473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:40.831781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.833487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104fb1e-7291-4c69-8d9f-c14996b33a85 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.846094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 427/850] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:40.846624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd50c-b530-4249-bee3-02b2edffafef None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.846912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd50c-b530-4249-bee3-02b2edffafef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.847187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd50c-b530-4249-bee3-02b2edffafef None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.852703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 428/851] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:40.852703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd50c-b530-4249-bee3-02b2edffafef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:40.861000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:40.861703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.861979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.862249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.862985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:40.864340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa869d-d80e-4d75-bd65-b93503085b9c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:40.885501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 424/852] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:40 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:40.885501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:40.885501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:40.885501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:40.899829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:40.901041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:40.937786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:40.984831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 425/853] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:40.985373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd50c-b530-4249-bee3-02b2edffafef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.008324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.026715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.027526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.027862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.028190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.036289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.037764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:41.054825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:41.055868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 15:14:41.056806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:41.060782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 429/854] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:14:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:41.062093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.081179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.137162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5564-8450-40e2-b703-fc39b4de66a8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.175654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.176810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.177316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.177771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.183056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83d39-38e3-4932-9933-ed3d6ed2c549 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.189784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:41.198393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:41.199461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:14:41.200281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:41.202901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 426/855] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:41.208865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.220897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.222223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.222515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.222790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.223675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:41.223977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.225401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.245236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 430/856] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:41.250838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.253072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.353437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.354866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f99b-411b-40fd-8583-14b4f3650f46 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.386573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc48b3-52ba-464e-9458-b938be232ff3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.403079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.403896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.404345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.404649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.405746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:41.406796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.408877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.425282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 427/857] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:41.425956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.436909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.438394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.439250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.440006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.516796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.518598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.519982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.532871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775dc96-a750-46c9-8d16-3454c0fee7c7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.568329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.569510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.570023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.570503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.582642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.584342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.598990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:41.603059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:41.603933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:41.604839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:41.604839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:41.604839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:41.604839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:41.611371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 428/858] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:41.613142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.637521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 431/859] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 15:14:41.639669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.742079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94d00-d102-4ee6-be95-ea145964efab None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.777799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.778085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad68f-b281-4503-8c48-84341cb6fc16 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.778912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.779900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.780323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.781295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:41.781847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.783559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.797114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 429/860] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:41.798298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.803712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.822949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.824119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.824608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.825078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.835540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.837311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:41.855859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:41.856753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:41.857659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:41.857659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:41.857659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:41.857659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:41.859825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 432/861] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:41.866328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:41.900105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:41.933253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bed4c-e0c7-4dbe-8b72-55846f7dcefb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.980477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b38d-04c0-4e7f-b72a-241d0d033a7e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:41.980746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:41.981564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:41.981967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:41.982523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:41.992723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:41.994497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:42.014346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:42.015621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:42.017582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 430/862] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:42.018841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.019316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.020191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.020191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.022004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:42.022004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.022207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.022557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.036008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 433/863] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:42.041743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.101371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.145162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aee31-e9ec-47bf-9959-3ffec3b7eddb None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.146733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.168204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b29b-6b5e-4ab5-93d6-b50fb9a71c80 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.181633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.182351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.182634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.182954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.183971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:42.184095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.185588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.208412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 431/864] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:42.209408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.217563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.218615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.219038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.219890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.229387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.231501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:42.249328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:42.250440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:42.251478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:42.253607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 434/865] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:42.260990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.340845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b8c7-294c-406b-82b1-647433c8aeea None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.363162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.383044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831487-fdfc-4ffa-92e4-dfb7437a155c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.384888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.385784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.386176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.386512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.422737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.423797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.424264 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.424745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.425823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:42.426469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.428099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.446640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 435/866] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:42.448337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.458177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.473931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.476217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.558886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a928e-513e-43eb-bf71-91f5759481e3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.599638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.600753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.601273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.601769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.602969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=530cf69a596d42eeb576903bb39816cc) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:42.603531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.605258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34436d-377a-4873-ba1c-f56afccb2aa0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.609980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 432/867] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:42.612049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.617201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 436/868] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/role_assignments?user.id=530cf69a596d42eeb576903bb39816cc&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:42.651352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.719009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161d013-8d19-4c05-b7ee-c5025a9f8e0b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.719345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161d013-8d19-4c05-b7ee-c5025a9f8e0b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.719568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161d013-8d19-4c05-b7ee-c5025a9f8e0b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.721219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 437/869] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:42.726665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275661-966b-431c-881b-77a45548d24a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.726955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275661-966b-431c-881b-77a45548d24a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.727265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8275661-966b-431c-881b-77a45548d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.744828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bed2-846b-4b31-b9b4-2d26067d7278 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:42.748576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c8275661-966b-431c-881b-77a45548d24a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:42.749801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c8275661-966b-431c-881b-77a45548d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:42.789413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:42.790396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:42.790684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:42.790958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:42.803173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:42.803711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:42.826409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:42.827306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:42.828174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:42.828174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:42.828174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:42.828174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:42.828174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 433/870] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:42.833196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.843076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.849025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 438/871] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:42.872561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275661-966b-431c-881b-77a45548d24a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:42.928201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:42.969820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a205e-bb8d-44c8-abe4-9a14a0cc65c3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.000159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8275661-966b-431c-881b-77a45548d24a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.015577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.016495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.017277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.017568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.018602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.018914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.020973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.037958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 434/872] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:43.044389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.047485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.048322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.048652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.048928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.049657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.051057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955e884-7579-4a41-b56f-2346de3ed62c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.078009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 439/873] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:42 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:43.078009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced90a-e38d-4dd8-8bbd-4e792faf06f9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.078009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced90a-e38d-4dd8-8bbd-4e792faf06f9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.078009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fced90a-e38d-4dd8-8bbd-4e792faf06f9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.078009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 440/874] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:43.083746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.084068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.084302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.110514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:43.112059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:43.178141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574ec11-559b-4be6-9bab-38898319c1b3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.194312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.210190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 441/875] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:43.231509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.232692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.232976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.233251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.234257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.235976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.246027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.247518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:43.264914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:43.266172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:43.267126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:43.270012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 435/876] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:43.272497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.366193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721839e6-f14b-4877-8485-baa40530bc3f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.406395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2bf7d-8da5-401a-9922-452540a8a24e None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.409108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.410616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.410901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.411177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.414478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.416643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:43.432691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:43.433690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:43.434564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:43.440669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 442/877] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:43.441417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.457967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.458650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.458937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.459215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.460430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.460751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.463125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.480059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 436/878] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:43.485416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.511846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.558637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.582336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2959-22de-41bc-a6e7-5406d2b970d8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.633410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cb7b4-ef27-49cd-bf9a-fe90955b08d1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.634377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.635528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.636910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.637438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.638400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.638912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.640758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.652797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 443/879] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:43.654139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.676991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.678084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.678577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.679103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.680206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=71223c29d15c41f8b5e0ec738b7b327c) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.680750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.682412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.689398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 437/880] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/role_assignments?user.id=71223c29d15c41f8b5e0ec738b7b327c&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:43.781293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a3897-4929-44f1-80a7-eca231b5d90b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.796847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.819707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.820382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.820663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.821474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.822242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.822547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.824017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.830600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 444/881] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:43.837287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:43.948956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456b47-0553-4855-ae43-a6120aa1c1b9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:43.963613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:43.986090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:43.986880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:43.987060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:43.987296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:43.988085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] RBAC: Adding query filter params (interface=public, service_id=54c3907f431c4e698a57b2059fa9a631, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:43.988395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:43.989747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89674fc8-d113-4f0a-82d2-bf697ca573a4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:43.997680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 438/882] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:43 2022] GET /identity/v3/endpoints?service_id=54c3907f431c4e698a57b2059fa9a631&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:44.003077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:44.106468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca42d4a-fa66-479d-8fbc-de49e460e67e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:44.141256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:44.141929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:44.142231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:44.142503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:44.143183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:44.144571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eced140-6758-4f74-a757-bb8ec2d43151 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:44.151525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 445/883] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:44 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:14:44.749354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60e51-30ae-4148-bf5b-0cb15b5666ef None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:44.749743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60e51-30ae-4148-bf5b-0cb15b5666ef None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:44.749944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60e51-30ae-4148-bf5b-0cb15b5666ef None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:44.751521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 439/884] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:44.756801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:44.757091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:44.757367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:44.775096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:44.776263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:44.813240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:44.846520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 446/885] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:44.869328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60e51-30ae-4148-bf5b-0cb15b5666ef None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:44.978924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60e51-30ae-4148-bf5b-0cb15b5666ef None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.013380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.014132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.014416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.014692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.015608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.016982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:45.029936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:45.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:45.031994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 440/886] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:45.036968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.138842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2c3b2-71d9-4e3c-9db7-2de9f995f237 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.174934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.176081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.176566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.177043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.177996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:45.178521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.180084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a562f-f51f-407a-b3e1-70cd38933457 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.185572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 447/887] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:45.190888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.219569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c51-1424-4e78-826c-26d37aaa267a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.220108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c51-1424-4e78-826c-26d37aaa267a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.220446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c51-1424-4e78-826c-26d37aaa267a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.222065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 448/888] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:45.226840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.227178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.227962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.237270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:45.245975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:45.247444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:45.280511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:45.326094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1323-7ac1-4b28-bb37-7b768f20c3fd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.334141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 449/889] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:45.352422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.364574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.365755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.366280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.366974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.368443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:45.369181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.371056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.378684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 441/890] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:45.470678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa249-ba0e-48f1-8803-8360c07fec9d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.508315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.509756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.510069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.510340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.510999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.512458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:45.526574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:45.527571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:45.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 450/891] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:45.534183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.653734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a7b9b-4973-41c8-9d9f-5a745a3ab24b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.661332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:45.691203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.691873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.692153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.692424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.693127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:45.693427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.694820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.700611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 442/892] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:45.706086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.737818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:45.813050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e83d0-7cf7-4831-b399-242e949eb7ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.848579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:45.849237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.849519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.850133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.850807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:45.851107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:45.852509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7383b-8590-49c9-ada6-f849a4fd9598 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:45.862253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 451/893] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:45.863929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:45.957147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed48df-c94c-4054-a597-944d37385bf2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.957803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed48df-c94c-4054-a597-944d37385bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.958315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed48df-c94c-4054-a597-944d37385bf2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.959873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 452/894] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:45.965564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:45.966101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:45.966210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935013d-b84b-4eb2-aee1-b97db66b5130 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:45.966718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:45.984761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:45.986391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:46.013512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.014225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.014478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.015668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.016502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] RBAC: Adding query filter params (interface=public, service_id=17ea32fa52dc46b2a6344f3d55da7a08, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:46.017150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.018797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.027214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 443/895] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:45 2022] GET /identity/v3/endpoints?service_id=17ea32fa52dc46b2a6344f3d55da7a08&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:46.032492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.070365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.070636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 453/896] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:46.091293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.118009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.153738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a3f95-448a-41b4-af03-52f98dc92eb5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.191166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.191940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.192224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.192493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.193271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.194659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5409672-88c4-421b-86eb-30a54a8e5077 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.202063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 444/897] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:14:46.218707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1d2c-d16d-40a9-b4df-7c0831aa7832 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.246179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3495df-67da-433d-ad18-94381f5852db None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.246495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3495df-67da-433d-ad18-94381f5852db None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.246743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3495df-67da-433d-ad18-94381f5852db None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.248395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 445/898] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:46.253842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.254156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.254435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.259966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.262061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.262388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.262666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.275258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:46.276342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:46.281469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:46.292094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:46.293122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:46.293988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:46.300312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 454/899] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:46.304835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.382231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 446/900] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:46.402200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.405604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.419199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0a50e-44c3-4377-8dfb-966b9ff20425 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.446708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.459739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.460405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.460687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.460960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.461803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:46.462272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.463647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.476524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 455/901] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:46.482163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.531701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328e865-f99b-48e5-a9f1-6ce5e090ba68 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.573713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.574617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.574893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.575196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.575860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.577289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:46.594337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:46.595391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:46.596206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 447/902] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:46.601549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.611252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ebdf-beeb-4ae3-b367-513635d14785 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.657216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.658170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.658521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.659166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.673219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.675344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.684732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:46.698743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:46.699681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:46.700563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:46.700563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:46.700563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:46.700563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:46.701003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 456/903] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:46.706993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.716367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.738399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176a4c-5285-4bda-ae05-1d754a912359 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.793612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.794310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.794584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.794850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.795548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:46.795847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.797204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.802623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 448/904] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:46.808467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.822014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e08908-39af-4bcf-869b-89ae822b4d5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.857049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.857852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.858175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.858527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.859318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:46.859727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.861158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.874219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 457/905] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:46.879532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:46.926454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587a255-7a23-48d9-bfb8-80b1e8a76e39 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:46.952574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:46.965167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:46.966214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:46.966876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:46.967397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:46.968398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:46.968913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:46.970541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:46.976720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 449/906] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:46.981920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.010859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa48dc-03ab-471d-bd83-6b13e8e85d2a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.011322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:47.059644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.060454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.060737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.061013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.070384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.072370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:47.092003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:47.092949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:47.093873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 458/907] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:47.099029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.104032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b1056-de40-4659-945b-44d78b72f4ef None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.142230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.143218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.143692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.144194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.145149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.146825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.172726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 450/908] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:14:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:47.237595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be8eff-2b88-44be-9354-f181c1f95f38 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.261212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:47.294262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.295346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.295839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.296347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.297474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:47.298096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.299786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7e4fc-125b-4370-8f53-59234d7eabf4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.322208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 459/909] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:47.328422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.416300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:47.442961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7d753-6e9e-40be-814b-af1647e89213 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.480860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.481884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.482418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.482918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.558033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.559507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.585706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e32b-c263-4814-84eb-00b90e3a1607 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.586178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e32b-c263-4814-84eb-00b90e3a1607 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.586612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e32b-c263-4814-84eb-00b90e3a1607 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.588304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 460/910] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:47.593232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.593619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.594044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.610938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:47.612239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:47.638805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:47.666790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 451/911] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:47 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:47.672320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.686030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 461/912] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:47.707960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.794016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e251-4f3a-42f3-94e8-d245a5a1b206 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.822770 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4839-975b-40a7-96c7-35514c11abc0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:47.824574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:47.839840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.841196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.841548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.842001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.855866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.857431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.863300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:47.864213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:47.864685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:47.865143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:47.866094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:47.867716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:47.878200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:47.879138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:47.880028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:47.880028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:47.880028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:47.880028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:47.884482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 452/913] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:47.885389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:47.888905 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 462/914] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:47 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:14:47.926736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:48.011205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d33fab-7939-4522-ac9e-e6ef2d590c26 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.056949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.057614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.057893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.058191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.058902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:48.059202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.060595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.072535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 453/915] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:48.078054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.187537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6724f0-bb1e-4c06-8279-cedee110d863 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.222685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.223826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.224319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.224822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.232564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.234288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3cc041b4-6d47-4715-8af1-0c05fe42c97b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:48.248655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:48.250015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:48.250901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:48.253405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 463/916] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:48.259540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.331764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c9c2-41a7-44cd-83f4-8f5947e5e6a5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.332041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c9c2-41a7-44cd-83f4-8f5947e5e6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.332239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8c9c2-41a7-44cd-83f4-8f5947e5e6a5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.333844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 464/917] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:48.339130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.339415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.339688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.350884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:48.360226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:48.361675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:48.374628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1a5a-aa60-474d-b840-7bc156b6c0ca None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.380471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:48.412264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.412928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.413209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.413478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.414395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:48.414740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.416291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.430175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 454/918] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:48.436027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.438016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 465/919] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:48.468739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.558704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ba124-7bec-4d3a-9958-aaad6a36467c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.584170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aefdf-7c34-4e9c-9efa-aa6a29fe4173 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.599392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.600390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.600880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.601381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.602497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] RBAC: Adding query filter params (role.id=f2a3c410b58f444c95f37d76d4fb0677, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=71223c29d15c41f8b5e0ec738b7b327c) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:48.603038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.604713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.610988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 455/920] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/role_assignments?user.id=71223c29d15c41f8b5e0ec738b7b327c&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=f2a3c410b58f444c95f37d76d4fb0677 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:48.629932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.629932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.629932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.629932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.630364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.630630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:48.645041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:48.646089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:48.646933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 466/921] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:48.654557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.667867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:48.774866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbd6ca-d30b-4d9c-8544-efb16624e6a6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.810487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.811156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.811437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.811714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.812415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:48.812720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.814197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.819526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 456/922] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:48.825628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:48.845459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:48.935262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769799-6dfd-49c1-94d0-a86c8367813a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:48.971457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:48.972496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:48.972990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:48.973501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:48.974460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:48.975078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:48.976655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706912b7-fac3-4ad0-a211-47caf9fc7b77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:48.982747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 467/923] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:48.988774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:49.066991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:49.099311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d052-f557-4bc7-90c7-bfded1fe889c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:49.141043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:49.141706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:49.142013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:49.142284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:49.143026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:49.144385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320400-afa6-4aca-8779-0cdb43c1e7ab None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:49.169660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 457/924] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:14:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:49.390993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8ba1-ec5c-4678-bd9b-dd56c050c903 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:49.391491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8ba1-ec5c-4678-bd9b-dd56c050c903 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:49.391491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8ba1-ec5c-4678-bd9b-dd56c050c903 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:49.393082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 468/925] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:49.398274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:49.398698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:49.399421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:49.417451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:49.418655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:49.500677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 458/926] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:49.524100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8ba1-ec5c-4678-bd9b-dd56c050c903 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:49.609275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:49.631039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8ba1-ec5c-4678-bd9b-dd56c050c903 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:49.666705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:49.667284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:49.667627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:49.667903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:49.668668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:49.670183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:49.676898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING keystone.server.flask.common [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 15:14:49.697370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 15:14:49.697370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 15:14:49.697370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [parameters: {'id': 'f6067b5386e849baa3b442620ea9a3d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 15:14:49.697370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6067b5386e849baa3b442620ea9a3d6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6067b5386e849baa3b442620ea9a3d6. Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:49.714654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 06 15:14:49.715513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() Jul 06 15:14:49.716445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 15:14:49.717305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 15:14:49.718263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:49.719049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'id': 'f6067b5386e849baa3b442620ea9a3d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:49.719908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:49.720692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6067b5386e849baa3b442620ea9a3d6. Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:49.721607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 469/927] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Jul 6 15:14:49 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:49.726342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:49.783404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:49.831419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb343-bf3a-43ed-a11c-e1c47db4eb04 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:49.866115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:49.867183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:49.867661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:49.868655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:49.875698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:49.877294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e663b285-6c2b-4b6f-91ab-75abe4122dda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:49.892134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:49.893243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:49.894384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:49.896441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 459/928] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:49.903152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.006823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abcf07-b42d-4cd8-bb24-a3295b91c08e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.044240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.044947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.045231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.045502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.046287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:50.046592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:50.048241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942e14-985e-4457-a003-a32d043f0dcd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:50.063543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:50.074288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 470/929] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:50.103872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e9697-b8d9-452f-93cd-559c6bb886f4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.104214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e9697-b8d9-452f-93cd-559c6bb886f4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.104431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e9697-b8d9-452f-93cd-559c6bb886f4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.105964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 460/930] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:50.113621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.113621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.113621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.130940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:50.132938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:50.212829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 471/931] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:50.235382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e9697-b8d9-452f-93cd-559c6bb886f4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.356977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e9697-b8d9-452f-93cd-559c6bb886f4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.374708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:50.398788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.399633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.399913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.400200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.400835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:50.402228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:50.414524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:50.415587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:50.416424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 461/932] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:50.421909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.527559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dcc54-3387-4f59-892d-2fc821f51a7b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.554829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:50.567975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.568574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.568859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.569144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.569940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:50.570258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:50.574128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f50ef-0cd4-4f0b-8b2c-d17de093c96f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:50.580048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 472/933] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:50.585269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.695460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa549-0a0e-45d8-bbf1-7f75f6c4d709 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.708743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4a9a-a7b3-4959-9777-1ab2b0c44057 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.709039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4a9a-a7b3-4959-9777-1ab2b0c44057 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.709304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4a9a-a7b3-4959-9777-1ab2b0c44057 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.710964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 473/934] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:50.717777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.718094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.718372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.736831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:50.738061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:50.741484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.742450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.743495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.743999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.744910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:50.745417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:50.747101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:50.752732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 462/935] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:50.761953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.816435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 474/936] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:50.817555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:50.838761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.882035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a776-fa06-4a34-9ddb-556d8e151d7a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.922511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.923275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:50.923681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:50.923957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:50.924752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] RBAC: Adding query filter params (interface=public, service_id=491f417f16c24095ad52be992d15af48, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:50.925061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:50.926591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:50.933264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 463/937] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/endpoints?service_id=491f417f16c24095ad52be992d15af48&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:50.938156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:50.954925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60453207-4d29-4be0-a480-0d0437bf2927 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:50.981947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:50.998977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:50.999920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.000205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.000474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.012884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:51.022225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:51.023164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:51.024056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:51.028534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 475/938] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:51.029858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.058905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ff8e-922f-41f6-8570-9189a2d1cdd3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.066434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.096888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.097589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.098019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.098396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.099203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.100799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.107530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 464/939] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:50 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:14:51.143716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec816a-0d8d-460d-abef-25e6ff652cd8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.183064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.183755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.184042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.184317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.185088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:51.185394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.186828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06795f0-e542-424f-adb9-4d05ac36cd9d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.198169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 476/940] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:51.204134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.319033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc27c4-be70-48c4-85d2-652d1598f9c3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.319541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5fe6-adfb-4de7-bf8d-966ec5ee5a47 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.319819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5fe6-adfb-4de7-bf8d-966ec5ee5a47 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.320101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5fe6-adfb-4de7-bf8d-966ec5ee5a47 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.321845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 477/941] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:51.327063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.327342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.327626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.348261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:51.349998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:51.356656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.357446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.357725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.358036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.370836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.372361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.389216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:51.392682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:51.393549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:51.394815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:51.394815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:51.394815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:51.394815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:51.394815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 465/942] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:51.401174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.425990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 478/943] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:51.429322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.450703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.518507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee060-4bdf-460d-b921-f1f08f4b5f58 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.556859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.557525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.557858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.558142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85a1f6-2038-44f9-9ceb-0affcda106de None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.558300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.558883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:51.559193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.560821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.574018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 466/944] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:51.579624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.595238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.596144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.596433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.596715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.597482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.598963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:51.612192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:51.614649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:51.616684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:51.626579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 479/945] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:51.626579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.658218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.673567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.695320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c5db-9d50-4cce-b7f9-b4cc4309f332 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.731735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a9553-8dd7-4dc2-bc2b-f0e0fa41d077 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.738117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.738951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.739238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.739518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.748583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.750109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:51.766886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:51.768019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:51.769166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 467/946] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:51.773102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.774031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.774462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.774726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.775037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.775891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:51.776348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.778048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.787681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 480/947] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:51.789380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:51.899576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:51.902784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b1c1-a9c8-4377-bbe7-d3842021d33d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.907887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578deba2-8c28-4768-977f-bc3c019b553b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:51.961261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.961980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.962260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.962544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.963251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:51.963556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.965177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.967390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:51.968917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:51.969714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:51.970436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 481/948] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:51.974025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:51.975230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:51.975908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:51.977718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:51.996505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:52.006928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 468/949] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:52.009843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.119776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031ecc4-1366-4375-b2ee-9a3c25c55377 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.156523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.157778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.158298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.158786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.170846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.172692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f1efe239-df98-4e75-b930-afe7a65575e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:52.192509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:52.193553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:52.194544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:52.194544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:52.194544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:52.194544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.201294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 482/950] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:52.202718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.312417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429980fb-b640-4f89-a23e-e2d4175313d9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.339695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5302-35c0-41c5-850e-6a25306330fc None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.339998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5302-35c0-41c5-850e-6a25306330fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.340290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b5302-35c0-41c5-850e-6a25306330fc None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.341797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 483/951] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:52.346920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.347434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.347900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.351580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.352774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.353052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.353320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.354071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:52.354371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.355976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.367505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:52.368873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 469/952] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:52.369787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:52.375303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.386471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:52.447861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 484/953] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:52.462945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:52.473163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.507279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff393bb-1cda-4c6f-9634-0c9c1bbb67db None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.544761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.545644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.545885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.546203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.553295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.554671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:52.569940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:52.571463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:52.573222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:52.576712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 470/954] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:52.578239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.608324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273358-dd9d-4db4-ac48-1bc0bc0b7573 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.655883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.656920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.657435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.657949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.659385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.661540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.684115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 15:14:52.684115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 15:14:52.684115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [parameters: {'user_id': '653b7379047946818f83ef8474b20887', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 15:14:52.684115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 15:14:52.691704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f1371-59e1-475c-a925-404a30e26111 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:52.695731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:52.696646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 15:14:52.697719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 15:14:52.698722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 15:14:52.701007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 15:14:52.704089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'user_id': '653b7379047946818f83ef8474b20887', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:52.706686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 06 15:14:52.709450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.712386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 485/955] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 15:14:52 2022] POST /identity/v3/users => generated 160 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:52.714748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:52.718918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.731947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.733019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.733019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.733225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.733998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:52.734310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.735800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.736064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:52.755417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 471/956] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:52.756694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:52.860509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbf0bf-fb62-4ccf-b0ea-a8abdb44af41 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.871098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c67cd-3106-4d62-b60f-4f3b6697b8d9 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:52.901596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.902817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.903314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.903822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.910137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:52.911030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:52.911312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:52.911784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/71223c29d15c41f8b5e0ec738b7b327c/roles/f2a3c410b58f444c95f37d76d4fb0677` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:52.912638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.914045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=71223c29d15c41f8b5e0ec738b7b327c, role_id=f2a3c410b58f444c95f37d76d4fb0677)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:52.914818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.915673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a52b8-506f-4540-be5b-5ad9d6946522 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:52.930566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:52.931566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 15:14:52.932511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:52.935250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 486/958] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:52.937988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 472/958] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:14:52 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/71223c29d15c41f8b5e0ec738b7b327c/roles/f2a3c410b58f444c95f37d76d4fb0677 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:14:52.940741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:53.018384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:53.056124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f2c9-0250-4c6c-bede-a2a313f82ed6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:53.094307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:53.094988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.095274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.095548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.096360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:53.096667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:53.098115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97fed5-1bec-4848-956f-f2c34e60db1b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:53.137638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 487/959] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 15:14:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:53.392728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed46af-14bb-48df-9e20-388abc8f2827 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.393179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed46af-14bb-48df-9e20-388abc8f2827 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.393531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed46af-14bb-48df-9e20-388abc8f2827 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.395011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 473/960] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:53.400393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.400685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.400965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.419066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:53.420568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:53.487666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 488/961] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:53.511181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed46af-14bb-48df-9e20-388abc8f2827 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:53.556663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:53.619906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed46af-14bb-48df-9e20-388abc8f2827 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:53.654951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:53.655750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.656029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.656299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.656940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:53.658330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:53.670611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:53.671977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:53.673049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 474/962] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:53.680836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:53.743382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:53.787235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0816-254b-4221-9939-00b33bdf2381 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:53.821652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:53.822499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.822881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.823252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.824050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:53.824453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:53.825922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:53.830950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 489/963] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:53.837064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:53.936116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deb926-0f08-4013-85fe-016881ed3829 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:53.938389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:53.971326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:53.971986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:53.972267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:53.972539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:53.973233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:53.973535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:53.974930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35bca-ae84-4c1f-9ecb-323f4915fcb2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:53.979913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 475/964] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:53.985437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:54.086560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e5b5-b606-438b-82de-c392cb807ba0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:54.108235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:54.123965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:54.124621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:54.124899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:54.125171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:54.125935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:54.127298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804563-92ba-419f-bb01-75a2dacb487d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:54.147619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 490/965] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:14:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:54.174501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020155d-916a-46ad-9823-b3225ecc8f3e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:54.174843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020155d-916a-46ad-9823-b3225ecc8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:54.175062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020155d-916a-46ad-9823-b3225ecc8f3e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:54.176658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 476/966] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:54.182740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07843-3419-4735-a6f7-ba74e507c12e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:54.183074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07843-3419-4735-a6f7-ba74e507c12e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:54.183465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b07843-3419-4735-a6f7-ba74e507c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:54.201863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a2b07843-3419-4735-a6f7-ba74e507c12e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:54.203119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2b07843-3419-4735-a6f7-ba74e507c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:54.282474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 491/967] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:54.305875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020155d-916a-46ad-9823-b3225ecc8f3e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:54.413968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020155d-916a-46ad-9823-b3225ecc8f3e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:54.449715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:54.450722 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:54.451159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:54.451601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:54.452556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:54.454146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9057596-a04f-4442-bc20-1cbe393c2686 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:54.468619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 477/968] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:14:54 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:14:55.024883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6386-803b-4b82-82fc-3817ea00eaca None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.025429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6386-803b-4b82-82fc-3817ea00eaca None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.025429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6386-803b-4b82-82fc-3817ea00eaca None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.027068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 492/969] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:55.032138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.032573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.032719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.049370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:55.050592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:55.074295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:55.127680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 478/970] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:55.151991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6386-803b-4b82-82fc-3817ea00eaca None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:55.254562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6386-803b-4b82-82fc-3817ea00eaca None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:55.256084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:55.294846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:55.295579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.295862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.296138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.311826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:14:55.320046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:55.321502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:55.322424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 493/971] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:55.329258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:55.427392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda020c4-dab7-4a44-8800-634d10107ec1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:55.461982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:55.462650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.462935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.463210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.463952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:55.464260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:55.465616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:55.473689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 479/972] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:55.479096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:55.580799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aea7e-665a-4273-bcae-75cd8deac07b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:55.615049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:55.615835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.616120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.616392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.627064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:55.628513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:55.646862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:55.647787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:55.648673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:55.648673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:55.648673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:55.648673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:55.650248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 494/973] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:55.653680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:55.672786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:55.756386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5abce2-0254-43c0-87bd-40b2b62903a3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:55.790940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:55.791604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.791913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.792188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.792906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:55.793210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:55.794599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:55.812485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 480/974] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:55.813723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:55.830413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:55.918430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f378-1a6b-416a-b597-b29a1b124ee3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:55.952758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:55.953816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:55.954280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:55.954721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:55.961863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:55.963512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:14:55.979032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:55.980180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 15:14:55.981360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:55.983676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 495/975] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:55.989128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.071238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.095146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1d5ae-1f4a-47f9-a008-0483fd05465b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.129776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.130489 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.130771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.131045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.131879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:56.132190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.134198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28f06-4e5c-4fe1-8a9d-951cabe0e7ef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.152415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 481/976] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 15:14:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:56.157789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.218812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc544-402e-4315-8c1a-8a91ac47f451 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.219141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc544-402e-4315-8c1a-8a91ac47f451 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.219362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc544-402e-4315-8c1a-8a91ac47f451 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.220842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 482/977] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:56.225430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.225709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.226005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.234968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.244360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:56.245528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:56.263157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9fa39-95ff-41ae-89ba-7a220e28f1fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.308257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.308894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.309181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.309458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.319410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 483/978] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:56.342859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.386391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.387855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e58fe-b44b-4db7-8d36-f3bd382ff5be None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.405000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.450348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd177f-0c7d-46aa-af4e-e83dd03e378a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.467852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.486418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.487196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.487503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.487781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.488425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.489783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.497181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 496/979] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:14:56.498538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78c45b-14f0-47ea-bc88-5f3b070ef3d7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.498830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78c45b-14f0-47ea-bc88-5f3b070ef3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.499100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78c45b-14f0-47ea-bc88-5f3b070ef3d7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.500373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 497/980] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-42358665-1c72-49f1-a6db-44e2c15e7080 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:56.502362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:56.503311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:56.504133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:56.504876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78c45b-14f0-47ea-bc88-5f3b070ef3d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.504946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 484/981] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:14:56.506611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.506894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.507167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.523978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:56.525138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:56.590355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 485/982] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:56.594116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.607647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78c45b-14f0-47ea-bc88-5f3b070ef3d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.642358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.643139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.643418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.643688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.650748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.654035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.655478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:14:56.673742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:56.674674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:56.675590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:14:56.675590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:14:56.675590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:14:56.675590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:56.675590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 498/983] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:56.675874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.700790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438209b8-6dc6-4fda-8e1f-051790427146 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.702555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.735411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.736079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.736379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.736709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.737353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:56.737655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.739062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.743905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 486/984] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:56.744587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.777820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ba0a-2cb4-4866-8be0-ee0f4821ce10 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.810280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.811056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.811333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.811603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.812240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.813586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:56.825972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:56.827130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:56.827970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 499/985] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:56.828796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.844997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429776a-4c70-4632-921e-9c04c3cf03b5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.866139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.878280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.878935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.879213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.879485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.880190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:56.880491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.881847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.894070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 487/986] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:56.894838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.916601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:56.926319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd213-35f1-4f75-8815-65768fa79868 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:56.959483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:56.960133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:56.960414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:56.960687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:56.961479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:56.961784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:56.963180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:56.967981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 500/987] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:56.968746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:56.993262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a56356-8bc9-4e6d-a79b-e9e99a03fd07 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.027977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.028857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.029133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.029507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.030251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.030562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.031929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.036612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 488/988] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.037371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.069269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e5f3-9025-4e3b-975b-6d8568cf6adf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.082496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:57.102751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.103531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.103812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.104086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.110563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.112002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:14:57.126449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:57.127496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:57.128372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 501/989] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:57.128860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.140583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6531ca-80ec-41b9-9be5-bc0bb1181097 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.143743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:57.174116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.174766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.175041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.175311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.176094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] RBAC: Adding query filter params (interface=admin, service_id=491f417f16c24095ad52be992d15af48, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.176398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.177744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.183416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 489/990] 10.222.0.25 () {56 vars in 1249 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/endpoints?service_id=491f417f16c24095ad52be992d15af48&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.184202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.229434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9567a-3f6b-4265-91a5-db469fbc475a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.263405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.263982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.264262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.264530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.265470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.265768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.267146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.271774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 502/991] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.272535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.285348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e32c5-896c-4159-b083-49ba15fe36fc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.296620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:57.321271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.321948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.322238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.322514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.323291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.323595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.325025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.336541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 490/992] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.337315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.354703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:57.376936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f01bc0-51f6-4cb5-94d4-5a79a2ea8eae None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.409624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.410310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.410589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.410861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.411529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.412881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.419821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 503/993] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:14:57.420606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.452935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bb8eb-090f-4cb6-93f1-13d9e0e1abd1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.490546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.491216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.491496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.491777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.493154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] RBAC: Adding query filter params (interface=public, service_id=1f594172d8d941dbbcc676c677d6fc75, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.493469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.494894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.505305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 491/994] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/endpoints?service_id=1f594172d8d941dbbcc676c677d6fc75&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.506482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:57.535752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49e5d-d19e-4576-9035-32d3e52e113f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.543575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:57.576346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.577013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.577293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.577566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.578448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] RBAC: Adding query filter params (role.id=f2a3c410b58f444c95f37d76d4fb0677, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=71223c29d15c41f8b5e0ec738b7b327c) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:57.578759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.580206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb1ab8-4541-44f4-b5e6-ea2c4a0123a8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.587010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 504/995] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/role_assignments?user.id=71223c29d15c41f8b5e0ec738b7b327c&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=f2a3c410b58f444c95f37d76d4fb0677 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:14:57.621589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb0d20-e66a-4cbe-9999-0929b55b3702 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:57.660326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:57.661008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:57.661288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:57.661561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:57.662356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:57.663759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e69683-858d-4f01-a405-b73f6c7a28a1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:57.673363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 492/996] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:14:57 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:14:59.455084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa2a8-db9c-4468-9854-3e6a394cb1d5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.455602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa2a8-db9c-4468-9854-3e6a394cb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.455680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fa2a8-db9c-4468-9854-3e6a394cb1d5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.457003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 505/997] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:59.462880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a0c0-8369-4527-9e9f-4d3929d860b4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.463279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a0c0-8369-4527-9e9f-4d3929d860b4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.463438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1a0c0-8369-4527-9e9f-4d3929d860b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.480792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cce1a0c0-8369-4527-9e9f-4d3929d860b4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:59.481998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cce1a0c0-8369-4527-9e9f-4d3929d860b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:59.549245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 493/998] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:59.572307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fa2a8-db9c-4468-9854-3e6a394cb1d5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:59.581789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:59.649732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249197-a66a-484e-8583-59018f4d1880 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.650061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249197-a66a-484e-8583-59018f4d1880 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.650325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249197-a66a-484e-8583-59018f4d1880 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.651828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 494/999] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:14:59.656487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe31d-96f7-4d9a-b33f-3d28197c4ee8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.656779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe31d-96f7-4d9a-b33f-3d28197c4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.657066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe31d-96f7-4d9a-b33f-3d28197c4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.673676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-88bfe31d-96f7-4d9a-b33f-3d28197c4ee8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:59.674884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88bfe31d-96f7-4d9a-b33f-3d28197c4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:59.677389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fa2a8-db9c-4468-9854-3e6a394cb1d5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:59.698472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:59.711770 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:59.712606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.712897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.713170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.713816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:59.715217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3f73356a-85b9-4fa8-aa19-719fdf43ab06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:59.727014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:59.727985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:14:59.729000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 506/1000] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 15:14:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:59.730301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883c9c-5c52-4e4a-87a1-083910716775 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.730301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883c9c-5c52-4e4a-87a1-083910716775 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.730301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883c9c-5c52-4e4a-87a1-083910716775 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.731660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 507/1001] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:14:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:14:59.736447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883c9c-5c52-4e4a-87a1-083910716775 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:59.750424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 495/1002] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:14:59.751692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184023-2767-4e65-9232-496390a538a2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.751974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184023-2767-4e65-9232-496390a538a2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.752245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184023-2767-4e65-9232-496390a538a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.771059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-be184023-2767-4e65-9232-496390a538a2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:14:59.772737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-be184023-2767-4e65-9232-496390a538a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:14:59.811594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:59.839812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 496/1003] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:14:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:14:59.840555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be184023-2767-4e65-9232-496390a538a2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:59.845429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883c9c-5c52-4e4a-87a1-083910716775 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:59.881070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:59.881725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.882044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.882324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.883505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:14:59.883818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:59.885177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:59.889893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 508/1004] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:14:59.890929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:59.928529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:14:59.941708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be184023-2767-4e65-9232-496390a538a2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:14:59.974756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:14:59.975600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:14:59.975834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:14:59.976113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] PATH_INFO: `/v3/services/image` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:14:59.976765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:14:59.978187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:14:59.990249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:14:59.991223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:14:59.992340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 497/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 15:14:59 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:14:59.994044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:14:59.996171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4502d-ec61-4920-a224-6ee41cafb6b5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.034359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.035141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.035419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.035691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.036332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.037691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.039469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:00.050110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:00.051311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:00.052172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 509/1006] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:14:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:00.052958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.099937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55fa-2ce7-4c7a-b465-8a246516d203 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.133683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.134372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.134655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.134925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.135617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:00.135921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.137264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.142413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 498/1007] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 15:14:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:00.143171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.150035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8cf6-274f-4d34-b7e3-79fcad067948 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.161624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.183094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.183833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.184114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.184385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.185079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] RBAC: Adding query filter params (name=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:00.185377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.186767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.191623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 510/1008] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:00.192472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.245557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa251e-4ef8-4a4a-921a-b63f39ecfc96 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.253981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.279528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.280187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.280467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.280742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.281435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:00.284741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.284741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.289009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 499/1009] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:15:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:00.290359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.294735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2f0c-0c8d-4ec0-bfd1-80039f123679 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.328435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.329091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.329371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.329643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.330406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.331762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.345834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 511/1010] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:15:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:00.346640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.384911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.409915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb27b-ae9c-442a-8c4b-0de4cbf184e8 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.454854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.455566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.455851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.456123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.456832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] RBAC: Adding query filter params (type=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:00.457133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.458562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.465941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 500/1011] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:00.467815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046a44-0098-4ac1-8aca-c2e543246fec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.495329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.515386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.516063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.516343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.516622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.517347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:00.517654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.519105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3802c-c6d9-43c8-b022-b27e906a15c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.525538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 512/1012] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 15:15:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:00.531624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:00.641792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec331-228e-4161-a1b1-e3b5b5229f79 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:00.675192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:00.675858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:00.676130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:00.676405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:00.677148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:00.678525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601745-5848-48df-8942-ca9c251e7d0e None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:00.686819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:00.701855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 501/1013] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:15:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:15:02.441669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5bee-156e-47a4-811d-b12293ee33ff None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.442207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5bee-156e-47a4-811d-b12293ee33ff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.442314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5bee-156e-47a4-811d-b12293ee33ff None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.443778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 513/1014] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:02.449346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.449752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.449948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.466632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:02.467824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:02.473400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dff4-4c78-49a5-bad5-4bcb73e0d2ad None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.473686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dff4-4c78-49a5-bad5-4bcb73e0d2ad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.473992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dff4-4c78-49a5-bad5-4bcb73e0d2ad None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.478008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 514/1015] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:02.480424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.480708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.480983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.498529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:02.499730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:02.553010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 502/1016] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:02.570032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 515/1017] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:02.584059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:02.593180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:02.692968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca308e4c-ad6f-4a73-93b1-6113a8cd5339 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:02.699615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11d62c-fed4-47cf-b52b-1c763c8a6d8e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:02.716599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:02.717590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:02.730659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:02.731467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.731751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.732028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.733209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:02.734682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:02.737368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:02.738068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.738348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.738618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.739340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:02.740692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f930-6b37-4e97-b55f-262ab5b642d2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:02.741410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 503/1018] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:02.742116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:02.757034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 516/1019] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:15:02 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:15:02.815647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b943d-a806-48bb-9ca2-dda294b6cd7d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.815980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b943d-a806-48bb-9ca2-dda294b6cd7d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.816222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b943d-a806-48bb-9ca2-dda294b6cd7d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.817777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 517/1020] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:15:02.823236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.823537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.823709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.841151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:02.842402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:02.861366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f443-76b8-4104-a980-008d3c80a5da None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:02.906890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:02.907799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:02.908087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:02.908602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:02.909060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:02.910558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:02.920850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 518/1021] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:02.940297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 504/1022] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:15:02 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:02.944895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.060227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73100bd6-1e5e-41a0-ae32-7c1b04c04c74 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.069044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:03.102296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.103039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.103328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.103604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.115307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:03.123956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:03.124882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:03.125724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 519/1023] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:15:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:03.131684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.177090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:03.240795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6933-a4b0-42d6-80be-b0362bbbdf4c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.276622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.277341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.277624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.277894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.278684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:03.279013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:03.280420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:03.290997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 505/1024] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:03.296691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.401763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84defd9-0f84-408c-8c37-c96862199b5e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.435128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.435926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.436206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.436477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.449583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:03.451078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:03.469082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:03.470024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:03.475566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:03.475566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:03.475566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:03.475566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:03.475566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 520/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:15:03.475895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.579725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:03.583607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659779-f22c-4e5f-a97d-f3dab5ca2e0f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.617793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.618485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.618769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.619042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.619759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:03.620170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:03.621546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:03.633977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 506/1026] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:03.639281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.659471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:03.739951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cbfe8-13a1-4419-aedf-c25d2ce964ba None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.774198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.774988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.775273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.775549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.783155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:03.784591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:15:03.798494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:03.799407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:03.800467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:03.802216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 521/1027] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:03.806680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:03.916000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859ef9-ac4b-4bb3-8d7b-811dac5011ba None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:03.951152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:03.951829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:03.952113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:03.952388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:03.953223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:03.953532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:03.955057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:03.976814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 507/1028] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:03.978034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.064112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:04.085460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ced5f-e8eb-466d-98e4-8c4f5041ca00 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:04.121185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:04.121828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.122137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.122413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.191242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:04.192607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:04.267610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:04.295808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 522/1029] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 15:15:04.297062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.317481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:04.402165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd726bd-0ccf-4f95-a79f-2f49e574d4e7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:04.436273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:04.437073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.437357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.437634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.448623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:04.450100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:04.467712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:04.468657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:04.469536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:04.469536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:04.469536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:04.469536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:04.470391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 508/1030] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:04.474549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.575714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a923356-fc03-42dd-82a2-18cc1c6c6657 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:04.610048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:04.610708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.610989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.611260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.611986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:04.612287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:04.613642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:04.629774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 523/1031] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:04.631293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.705872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:04.738419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc91fea-4a6f-4cde-a333-b8d1a0a68d68 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:04.774552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:04.775358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.775702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.775968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.783005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:04.784445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c9b6cbed-b1a9-41f0-b667-9343ac02f360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:15:04.798990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:04.799870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:04.800760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:04.802226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 509/1032] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:04.806465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.821308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac074-af19-4cec-9b23-14570ad8a175 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.821590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac074-af19-4cec-9b23-14570ad8a175 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.821871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac074-af19-4cec-9b23-14570ad8a175 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.823236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 510/1033] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:15:04.827953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.828240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.828507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.844907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:04.846110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:04.850357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:04.917929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 511/1034] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:04.918984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22c5f5-83ad-4726-8a4c-321301826a16 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:04.941002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:04.956108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:04.956703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:04.956986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:04.957288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:04.958070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:04.958378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:04.959813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:04.972654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 524/1035] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:04.978823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.002564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.053012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28e27-9d7d-476e-a51d-5b1bcb69c4b7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.078412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.082080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3180-6db4-42b9-b326-df42e93cfedf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.087692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.088574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.088928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.089275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] PATH_INFO: `/v3/services/image` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.089958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.091322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-44f2f5b2-8c34-4c4d-98c0-038c8724f2ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:05.103239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:05.104312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:05.105332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 512/1036] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:15:05.106731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750f92-d648-45f8-9b11-e437def789e6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.106731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750f92-d648-45f8-9b11-e437def789e6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.106731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750f92-d648-45f8-9b11-e437def789e6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.107570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 513/1037] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:05.110224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750f92-d648-45f8-9b11-e437def789e6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.121306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.121990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.122275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.122549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.123374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] RBAC: Adding query filter params (role.id=f2a3c410b58f444c95f37d76d4fb0677, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:05.123682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.125120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b600-7224-4be6-a29b-281a7130fd0c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.132713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 525/1038] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:04 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=f2a3c410b58f444c95f37d76d4fb0677 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:05.132713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.132713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.132713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.150323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:05.151652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:05.230491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750f92-d648-45f8-9b11-e437def789e6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.242449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 526/1039] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:05.260138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.268197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.281491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.282904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.282904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.282904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.283544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] RBAC: Adding query filter params (name=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:05.284468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.285371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.291972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 514/1040] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:05.297821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.365160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.375784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e72f-142b-4c93-9b0f-9d8b74097a10 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.404453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addb474-9ac6-43b1-b1de-f0dfce80679c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.412223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.413011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.413292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.413561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.415307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.416746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.423084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 527/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:05.423948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.447608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.448275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.448558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.448832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.449538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:05.449844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.451239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.457381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 515/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:05.463594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.532507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.560362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd091-016c-44cd-84c2-c7843218ae48 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.592833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f4ce8-6df6-47f1-aae1-99a7e34ecea6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.598813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.599490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.599771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.600044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.600766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.606539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.632748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.635321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.635902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.636586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.637996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] RBAC: Adding query filter params (interface=public, service_id=aa7f2534efc545fe8bc8071113721ccc, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:05.638526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.640685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29ceff-8e86-49c5-ba68-351b769c7a73 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.645941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 528/1043] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:15:05 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:15:05.656992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 516/1044] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:15:05 2022] GET /identity/v3/endpoints?service_id=aa7f2534efc545fe8bc8071113721ccc&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:05.663085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:05.685923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:05.788502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917e04d-1593-4318-a737-2f5231f6f5d6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:05.828857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:05.829690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:05.830113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:05.830492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:05.831282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:05.832767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d914e-0c45-4355-ba83-335c2f21332e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:05.840545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 529/1045] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:15:05 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:15:07.140435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4e7c-36ea-4550-a500-bba9a0779c3c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.140960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4e7c-36ea-4550-a500-bba9a0779c3c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.140960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4e7c-36ea-4550-a500-bba9a0779c3c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.142387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 517/1046] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:07.147333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.147723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.147879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.164968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:07.166167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:07.233729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 530/1047] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:07.256158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4e7c-36ea-4550-a500-bba9a0779c3c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:07.365111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4e7c-36ea-4550-a500-bba9a0779c3c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:07.382612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:07.401627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:07.402403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.402681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.402958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.412989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:07.421543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:07.422649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:07.423504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:07.426223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 518/1048] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:15:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:07.428709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:07.440463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:07.529997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7619202-054c-4c37-a16d-e22c056ff32b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:07.563785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:07.564448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.564718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.564989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.565724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:07.566068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:07.567423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:07.576019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 531/1049] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:15:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:07.581253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:07.680522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cfc2e-9723-4045-84db-4df0d14f8b7b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:07.713713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:07.714529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.714809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.715077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.725707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:07.727751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-1014e24f-435a-428b-b655-869b1ccbbd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:07.744572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:07.745482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:07.746405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:07.746405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:07.746405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:07.746405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:07.750195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 519/1050] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:07.751575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:07.830522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:07.836050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51c17-a822-497d-ac2f-a31c43dbbb89 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.836858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51c17-a822-497d-ac2f-a31c43dbbb89 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.837137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51c17-a822-497d-ac2f-a31c43dbbb89 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.838546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 520/1051] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:07.843346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612573-347a-4d25-9fdc-ce010fd22675 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.843633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612573-347a-4d25-9fdc-ce010fd22675 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.843911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612573-347a-4d25-9fdc-ce010fd22675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.860364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c0612573-347a-4d25-9fdc-ce010fd22675 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:07.861525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c0612573-347a-4d25-9fdc-ce010fd22675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:07.863390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53394465-cc48-41ec-a38d-af3fb972d848 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:07.886155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:07.903209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:07.903895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.904182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.904465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.905191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:07.905918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:07.907309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3e76-d762-41d2-a7fa-219f847c9214 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:07.918974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 532/1052] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:07.920028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2601e-7cda-4e0d-b357-06cda7ecd9b0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.920316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2601e-7cda-4e0d-b357-06cda7ecd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.920595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2601e-7cda-4e0d-b357-06cda7ecd9b0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.921823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 533/1053] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:07.924229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2601e-7cda-4e0d-b357-06cda7ecd9b0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:07.935587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 521/1054] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:07.936788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:07.937076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:07.937353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:07.956773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:07.958172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:08.025229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 522/1055] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:08.026181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.027410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2601e-7cda-4e0d-b357-06cda7ecd9b0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.061267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.067322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.068466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.068748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.069333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.076555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.078040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:15:08.093058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:08.093980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:08.094913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 534/1056] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:15:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:15:08.095564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.117959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.130176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1b6ef-e933-4020-b7ae-87fce187ed52 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.164031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.165361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.165641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.165941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.175895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:08.183864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:08.184960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 523/1057] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:08.186500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.196373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38b86-6a05-4949-adf0-5a0cf2f7a1ea None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.230396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.231172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.231455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.231723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.232369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.233724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:08.245045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:08.246060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:08.252224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 535/1058] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:08.253207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.285417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572adb59-85fb-46af-89cc-dc496dc3e9a5 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.306738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.322628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.323296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.323578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.323852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.324684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:08.324988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.326451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.343700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 524/1059] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.344482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.349605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd388-e1c5-48f9-9149-9b9bc75d8b55 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.354848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.383837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.384498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.384780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.385056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.385799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:08.386133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.387516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.395759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 536/1060] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.396546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.444718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3246cc-d000-4031-88f6-f00fa1da6ffa None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.478284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.478944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.479222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.479495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.480185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] RBAC: Adding query filter params (name=image) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:08.480486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.481839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.486660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 525/1061] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.487418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.497732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01237f9-18e1-4287-8fec-23049ee24573 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.514741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.532326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.533118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.533400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.533670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.543951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.545381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.554918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:08.562474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:08.563375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 537/1062] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:08.564516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.589702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742150-b37d-421d-bf20-b7234b0adc63 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.622741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.623604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.623888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.624160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] PATH_INFO: `/v3/users/c86df71eeede469497ae04a105b56797` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.637726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c86df71eeede469497ae04a105b56797)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.639217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.641169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 526/1063] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/users/c86df71eeede469497ae04a105b56797 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.641917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.666063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeec78-4a2c-455b-bbde-520d321f91f5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.699165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.699826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.700108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.700390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.701086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:08.701388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.702793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.707476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 538/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.708238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.741318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.744320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1cbdc-47b6-4189-99d6-55aadf65b4d1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.770701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:08.779264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.779920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.780200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.780472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.781183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:08.781484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.782870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.793925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 527/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:08.794538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.809996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795fc7-394b-465f-9807-2fe7f24ccd25 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.844307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.844975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.845254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.845526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.892469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439921ea-b989-46af-987c-611dedec00a3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:08.914053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.915517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.925766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:08.926435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:08.926714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:08.926987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:08.927709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:08.929040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:08.947741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 528/1066] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:15:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:08.948530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:08.954750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:09.011083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:09.027936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 539/1067] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:09.034387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:09.088203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082befdf-bdda-4c5f-899c-928d776b1fec None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:09.128520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:09.129315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:09.129593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:09.129876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:09.137365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:09.138850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:09.144613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ba8a-2429-4a40-9052-8e2f5484ca30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:15:09.153467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:09.154576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:09.155466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:09.156057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 529/1068] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:09.161947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:09.181406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:09.182271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:09.182551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:09.182817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:09.184296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:09.185518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:09.192354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 540/1069] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:09 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:09.193474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:09.196878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:09.266355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:09.269747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd60b-e3a7-4afc-92f2-a6b8736b5383 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:09.312877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:09.313548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:09.313828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:09.314143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:09.314930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:09.315234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:09.316212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cf8a-195f-4a60-ac6c-67dd07237bcb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:09.316667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:09.331654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 530/1070] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:09.337366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:09.355511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:09.356160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:09.356438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:09.356841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:09.357523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642, user.id=c86df71eeede469497ae04a105b56797) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:09.357830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:09.359325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84874f83-1a18-4595-b9d1-f69cd80a2aa3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:09.365335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 541/1071] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:09 2022] GET /identity/v3/role_assignments?user.id=c86df71eeede469497ae04a105b56797&scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:09.448112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0eda3-4b10-4f24-a39a-81fd0dbe7431 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:09.484408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:09.485315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:09.485591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:09.485858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/f2a3c410b58f444c95f37d76d4fb0677` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:09.488134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=92191aff46eb4e98b5923c3ad95a8012, role_id=f2a3c410b58f444c95f37d76d4fb0677)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:09.489583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86929e06-194d-4f66-999c-4133ce853ae1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:09.505945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 531/1072] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:15:09 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/92191aff46eb4e98b5923c3ad95a8012/roles/f2a3c410b58f444c95f37d76d4fb0677 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:15:10.988939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a445e0d-61a9-4b3a-8150-c9fc63528f81 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:10.989466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a445e0d-61a9-4b3a-8150-c9fc63528f81 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:10.989466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a445e0d-61a9-4b3a-8150-c9fc63528f81 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:10.990932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 542/1073] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:10.996097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313ace-56aa-42eb-8d2c-11e2a75de8ec None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:10.996487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313ace-56aa-42eb-8d2c-11e2a75de8ec None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:10.996650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313ace-56aa-42eb-8d2c-11e2a75de8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.013850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-89313ace-56aa-42eb-8d2c-11e2a75de8ec None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:11.015302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89313ace-56aa-42eb-8d2c-11e2a75de8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:11.030361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.085119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 532/1074] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:11.107535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a445e0d-61a9-4b3a-8150-c9fc63528f81 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.178063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.215586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a445e0d-61a9-4b3a-8150-c9fc63528f81 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.249346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.249931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.250215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.250485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.322046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:11.323819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:11.387223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.391253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743616-c34e-49f2-b563-07b78350fb7a None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.391753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743616-c34e-49f2-b563-07b78350fb7a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.392033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743616-c34e-49f2-b563-07b78350fb7a None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.393664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 533/1075] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:11.398682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788dd65-a1c2-4f2a-82bf-837e06ee13bd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.398975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788dd65-a1c2-4f2a-82bf-837e06ee13bd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.399257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788dd65-a1c2-4f2a-82bf-837e06ee13bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.415400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b788dd65-a1c2-4f2a-82bf-837e06ee13bd None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:11.416571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b788dd65-a1c2-4f2a-82bf-837e06ee13bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:11.426314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:11.432382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.484712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 534/1077] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:11.495243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5845-28e9-4eb3-bab5-776ca0ef0e92 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.495531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5845-28e9-4eb3-bab5-776ca0ef0e92 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.495809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e5845-28e9-4eb3-bab5-776ca0ef0e92 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.497251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 535/1078] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:15:11.502092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.502326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.502604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.520390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:11.521568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:11.547046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714797-13b2-4b3c-a255-447502e17409 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.580615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.581400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.581678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.581979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.586677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 536/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:11.587487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.593913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:11.595658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:11.599355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:11.615381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:11.616288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:11.617741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:11.617741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:11.617741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:11.617741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:11.617741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 544/1080] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:15:11.618563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.637575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.693539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7cc04-3e4b-4621-9122-19af781b0f30 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.717150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38317882-cee9-4c3d-bf8e-de4186c05198 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.727267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.728054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.728334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.728607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.739069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:11.747213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:11.748144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:11.749330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 537/1081] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:11.750296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.752740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.753548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.753672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.753876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.764055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:11.772398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:11.773315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 545/1082] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:11.774439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.824744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.851991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:11.856088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8f14-51c9-4129-8a84-3082eb006404 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.873844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5769c7-4358-48ba-83d1-db376c3b1cfd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:11.889531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.890483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.890767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.891041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.891782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:11.892088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:11.893448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:11.905670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 538/1083] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:11.906478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:11.910974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:11.911654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:11.911931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:11.912203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:11.912960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:11.913262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:11.915279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:11.924668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 546/1084] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:11.930859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.028962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d306-e1f5-443b-aa89-0e343c24fd83 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.042881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d600b-e0bc-498b-89d0-c6bb9da0a66f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.063572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.071406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.072089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.072376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.072654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.073406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:12.073715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.076784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.085436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 539/1085] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:12.086538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.087650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.087934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.088209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] PATH_INFO: `/v3/users/c86df71eeede469497ae04a105b56797` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.089433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c86df71eeede469497ae04a105b56797)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.090908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.091330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.093421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 547/1086] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:11 2022] GET /identity/v3/users/c86df71eeede469497ae04a105b56797 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:12.098610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.111903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.213599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efaf0-eb03-480b-9e13-0a6a3ed29274 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.216365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec24c0-43c8-4c8c-ba79-3931e04bb1b4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.246800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.247586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.247868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.248147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.249251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.250138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.250419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.250688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.251882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.253323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.255062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 548/1087] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:12.259321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.260748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.261427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:12.277804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:12.278949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:12.280103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:12.280103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:12.280103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:12.280103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:12.280103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 540/1088] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:15:12.284634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.331118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.342992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.365893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92dfcc-6e14-4f11-afbf-5c85fcdf2a7a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.384600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ce4a-221c-4706-9fb3-f41c250252b7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.399930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.400813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.401092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.401369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642/users/c86df71eeede469497ae04a105b56797/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.403347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] RBAC: Authorizing `identity:create_grant(project_id=ceb5cb6c6d8b440688dc3339baa4f642, user_id=c86df71eeede469497ae04a105b56797, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.404779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.417844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.418197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 549/1089] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:15:12 2022] PUT /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642/users/c86df71eeede469497ae04a105b56797/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:15:12.418534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.418835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.419094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.419813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:12.420121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.421490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.438338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 541/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:12.444175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.553826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162a99-75ed-40c6-ba53-43d613f3537f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.590146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.590929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.591208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.591480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.594250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.600107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.611912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:15:12.630851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:12.632003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:12.633927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 550/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:12.638240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.735525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b380012-fcaa-46c8-80f3-6b2004267185 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.737814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.770248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.770915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.771201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.771476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.772306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:12.772612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.774058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:12.790726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 542/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:12.796334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:12.894439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7adbf-4b71-4585-9d5e-ed94ac198690 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:12.926722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:12.927358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:12.927640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:12.927915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:12.987440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:12.994541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:12.995980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.091516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 551/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 15:15:13.097049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:13.195323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c136c07-02be-4042-a41a-24a573bab371 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:13.228750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:13.229533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:13.229814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:13.230115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:13.239928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:13.241365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:13.258986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:13.260009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:13.261116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:15:13.261116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:13.261116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:15:13.261116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:13.261116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 543/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:13.265977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:13.360153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:13.366529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0e42-b8a5-4ad1-845a-9dc9cbda96bf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:13.400986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:13.401633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:13.401943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:13.402224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:13.402938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:13.403241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:13.404598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.415408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 552/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:13.421052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:13.436861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:13.523453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887dff-6237-4735-957f-109e7d0f2735 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:13.557488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:13.558319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:13.558602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:13.558888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:13.565911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:13.567389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:15:13.581687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:13.582689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:15:13.583597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:13.586189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 544/1096] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:13.588724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:13.685572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e41415-f2b3-4cd3-8fcc-8c628789a2c5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:13.717574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:13.718249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:13.718530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:13.718804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:13.719588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:13.719891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:13.721320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4867843-c3e8-4c56-bb74-8ddf77eedc63 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.732790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 553/1097] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:13.738729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:13.814668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:13.839663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3feb-8b33-4182-9700-b9a735089b48 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:13.873970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:13.874622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:13.874904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:13.875180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:13.876005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] RBAC: Adding query filter params (role.id=f2a3c410b58f444c95f37d76d4fb0677, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=92191aff46eb4e98b5923c3ad95a8012) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:13.876313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:13.877740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311287-219b-4403-bf12-8681114a80ad None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:13.884148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 545/1098] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:13 2022] GET /identity/v3/role_assignments?user.id=92191aff46eb4e98b5923c3ad95a8012&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=f2a3c410b58f444c95f37d76d4fb0677 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:14.420382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc505-718c-4faa-9c3b-579a1e826aa0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:14.420885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc505-718c-4faa-9c3b-579a1e826aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:14.420977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc505-718c-4faa-9c3b-579a1e826aa0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:14.422316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 554/1099] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:14.427420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:14.427859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:14.427982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:14.445200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:14.446935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:14.513810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 546/1100] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:14.537300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc505-718c-4faa-9c3b-579a1e826aa0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:14.556494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:14.640252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc505-718c-4faa-9c3b-579a1e826aa0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:14.673642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:14.674464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:14.674744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:14.675018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:14.685809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:14.693393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:14.694469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:14.695350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 555/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:14.700680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:14.768426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:14.801220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9472-65f0-4c21-9112-6dec31e7d39b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:14.834466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:14.835597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:14.835913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:14.836187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:14.836927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:14.837232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:14.838625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:14.846440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 547/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:14.852711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:14.928028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:14.951089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1dda7-bba6-4b1e-b37b-5c877d0be1fb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:14.982637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:14.983481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:14.983763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:14.984038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] PATH_INFO: `/v3/users/c86df71eeede469497ae04a105b56797` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:14.985209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] RBAC: Authorizing `identity:get_user(user_id=c86df71eeede469497ae04a105b56797)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:14.986661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:14.988265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 556/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:14 2022] GET /identity/v3/users/c86df71eeede469497ae04a105b56797 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:14.994496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:15.091205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcadc5-90fe-4959-91c9-867677def3bd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:15.118419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:15.124020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:15.124655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:15.124938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:15.125215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:15.189775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:15.191174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:15.285694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 548/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:15.291870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:15.387613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080144-ae12-4b3e-aa11-a65329b4807e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:15.419423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:15.420256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:15.420529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:15.421012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:15.421969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:15.423381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a34c1-4253-4d25-ba5c-740821b72988 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:15.425039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 557/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:15 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:15.430966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:15.459688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:15.525869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec818-cab9-416e-8dc3-09c89d452905 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:15.558218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:15.558847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:15.559123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:15.559392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:15.560196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642, user.id=c86df71eeede469497ae04a105b56797) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:15.560496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:15.561923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bc50-b508-44aa-a6d9-227fc6e2d61d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:15.567499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 549/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:15 2022] GET /identity/v3/role_assignments?user.id=c86df71eeede469497ae04a105b56797&scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:17.580331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6305-2af0-4407-a0f1-949f32e0814b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:17.580830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6305-2af0-4407-a0f1-949f32e0814b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:17.580830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf6305-2af0-4407-a0f1-949f32e0814b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:17.582204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 558/1107] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:17.587357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:17.587750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:17.587902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:17.604637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:17.605794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:17.669041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 550/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:17.693019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf6305-2af0-4407-a0f1-949f32e0814b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:17.707788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:17.792383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf6305-2af0-4407-a0f1-949f32e0814b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:17.825275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:17.826074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:17.826356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:17.826629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:17.827792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:17.829223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d26d46-5fc7-47b0-a301-1d7345c3252a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:17.830912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 559/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:17.837187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:17.867403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:17.941177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe11c6-7371-4d1b-8274-a3b451af6404 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:17.974357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:17.975025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:17.975310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:17.975587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:17.976304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:17.977729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd762ec-1390-4160-bc93-05854ac58e08 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:17.996920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 551/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:15:17 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:20.024885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca5ae-57c0-4498-8146-953bdef4d7bd None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.025419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca5ae-57c0-4498-8146-953bdef4d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.025419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca5ae-57c0-4498-8146-953bdef4d7bd None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.026827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 560/1111] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:20.032061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.032478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.032622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.049502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:20.050713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:20.114692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 552/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:20.138229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca5ae-57c0-4498-8146-953bdef4d7bd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:20.218357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:20.238455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca5ae-57c0-4498-8146-953bdef4d7bd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:20.272582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:20.273962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.274243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.274515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] PATH_INFO: `/v3/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.276023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] RBAC: Authorizing `identity:get_role(role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:20.277346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:20.278733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 561/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:20 2022] GET /identity/v3/roles/1801c155c74646c1a128d958c3f795a4 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:20.284425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:20.296740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:20.381868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4ea5b-a886-4f46-b278-ddf675ca9c7f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:20.415449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:20.416313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.416599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.416875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] PATH_INFO: `/v3/users/62ca612dfd13417d8ff0a5e1328a50d9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.429512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] RBAC: Authorizing `identity:get_user(user_id=62ca612dfd13417d8ff0a5e1328a50d9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:20.430984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:20.432609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 553/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:20 2022] GET /identity/v3/users/62ca612dfd13417d8ff0a5e1328a50d9 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:15:20.438292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:20.533497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06521d69-07d0-4a88-9315-9e0387e3c159 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:20.565166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:20.565794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.566104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.566381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.583447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:20.630992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:20.632419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:20.726076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 562/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:20.731828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:20.796675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:20.828827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7731-e313-4075-bb2a-aee869f46245 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:20.862209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:20.863060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:20.863341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:20.863615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:20.864793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:20.866252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a256d-8996-407b-b625-3a2e15055cec None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:20.867960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 554/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:20 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:20.873965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:20.920588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:20.968860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac38fe7-ed25-40e8-aa67-4c18dd40bfd6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:21.000839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:21.001464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:21.001743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:21.002041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:21.002857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642, user.id=62ca612dfd13417d8ff0a5e1328a50d9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:21.003160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:21.004558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98225a-707a-43a4-86af-190b2b8d9b41 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:21.010399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 563/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:20 2022] GET /identity/v3/role_assignments?user.id=62ca612dfd13417d8ff0a5e1328a50d9&scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642&role.id=1801c155c74646c1a128d958c3f795a4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:22.974845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac013-d9c3-48d8-86b6-f61fcee050fe None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:22.975480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac013-d9c3-48d8-86b6-f61fcee050fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:22.975480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac013-d9c3-48d8-86b6-f61fcee050fe None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:22.976750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 555/1118] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:22.981826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:22.982241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:22.982406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:22.998551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:22.999707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:23.062953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 564/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:23.085299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac013-d9c3-48d8-86b6-f61fcee050fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:23.184119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac013-d9c3-48d8-86b6-f61fcee050fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:23.216329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:23.217156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:23.217436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:23.217707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] PATH_INFO: `/v3/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:23.219183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] RBAC: Authorizing `identity:get_role(role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:23.220541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:23.221857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 556/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:23 2022] GET /identity/v3/roles/1801c155c74646c1a128d958c3f795a4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:23.227491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:23.268729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:23.322702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd857-8c28-4781-b116-e640c53bb670 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:23.355510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:23.356363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:23.356644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:23.356920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] PATH_INFO: `/v3/users/62ca612dfd13417d8ff0a5e1328a50d9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:23.358113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] RBAC: Authorizing `identity:get_user(user_id=62ca612dfd13417d8ff0a5e1328a50d9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:23.359555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:23.361165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 565/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:23 2022] GET /identity/v3/users/62ca612dfd13417d8ff0a5e1328a50d9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:23.367454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:23.371161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:23.464276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b8f8-2660-4ea8-a430-819cf5bf7d66 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:23.496459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:23.497238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:23.497514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:23.497788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:23.498968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:23.500379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e6c2e-c88e-4f75-8dd6-593136567ab5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:23.502045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 557/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:23 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:23.508416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:23.604713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e048056-dfb6-493b-9473-7f5ab7308c2a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:23.614825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:23.637573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:23.638493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:23.638772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:23.639041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642/users/62ca612dfd13417d8ff0a5e1328a50d9/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:23.641467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] RBAC: Authorizing `identity:create_grant(project_id=ceb5cb6c6d8b440688dc3339baa4f642, user_id=62ca612dfd13417d8ff0a5e1328a50d9, role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:23.642912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8250e2-4187-45f7-b677-9c4980320246 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:23.654956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 566/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:15:23 2022] PUT /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642/users/62ca612dfd13417d8ff0a5e1328a50d9/roles/1801c155c74646c1a128d958c3f795a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:15:25.632159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e5f6-61a0-454b-a199-fe7848ebb7d0 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:25.632691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e5f6-61a0-454b-a199-fe7848ebb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:25.632691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e5f6-61a0-454b-a199-fe7848ebb7d0 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:25.634040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 558/1124] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:25.639131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:25.639569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:25.639668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:25.656649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:25.657821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:25.720868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 567/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 15:15:25.744254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794e5f6-61a0-454b-a199-fe7848ebb7d0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:25.813138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:25.843887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794e5f6-61a0-454b-a199-fe7848ebb7d0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:25.881699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:25.883206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:25.883427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:25.883698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] PATH_INFO: `/v3/roles/1801c155c74646c1a128d958c3f795a4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:25.885166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] RBAC: Authorizing `identity:get_role(role_id=1801c155c74646c1a128d958c3f795a4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:25.886569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:25.887933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 559/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:25 2022] GET /identity/v3/roles/1801c155c74646c1a128d958c3f795a4 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:25.894158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:25.985955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:25.988944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347936ef-28fa-48e1-b1e5-54829b800e9e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:26.022442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362d433-809a-4727-aa61-430fa818765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:26.023844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362d433-809a-4727-aa61-430fa818765a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:26.024120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362d433-809a-4727-aa61-430fa818765a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:26.024392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362d433-809a-4727-aa61-430fa818765a None admin] PATH_INFO: `/v3/users/62ca612dfd13417d8ff0a5e1328a50d9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:26.025545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362d433-809a-4727-aa61-430fa818765a None admin] RBAC: Authorizing `identity:get_user(user_id=62ca612dfd13417d8ff0a5e1328a50d9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:26.027006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362d433-809a-4727-aa61-430fa818765a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:26.028653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 568/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:25 2022] GET /identity/v3/users/62ca612dfd13417d8ff0a5e1328a50d9 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:26.034452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:26.135246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f5cc-7a3c-483b-a076-7a15002d7294 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:26.167561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:26.168193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:26.168471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:26.168739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:26.178932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:26.234585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:26.236019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:26.331508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 560/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:26.337983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362d433-809a-4727-aa61-430fa818765a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:26.432774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362d433-809a-4727-aa61-430fa818765a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:26.465150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:26.466019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:26.466299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:26.466568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] PATH_INFO: `/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:26.467727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=ceb5cb6c6d8b440688dc3339baa4f642)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:26.469153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6205d21-e64e-48ef-8064-946d7a39c3e8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:26.470854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 569/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:26 2022] GET /identity/v3/projects/ceb5cb6c6d8b440688dc3339baa4f642 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:26.476886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:26.518393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:26.574067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63f9d-4797-4159-8eff-7e8a9ab874cc None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:26.606588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:26.607224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:26.607506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:26.607777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:26.608590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] RBAC: Adding query filter params (role.id=1801c155c74646c1a128d958c3f795a4, scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642, user.id=62ca612dfd13417d8ff0a5e1328a50d9) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:26.608900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:26.610347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd6e9-233d-4e2f-a888-275c55619365 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:26.615943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 561/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:26 2022] GET /identity/v3/role_assignments?user.id=62ca612dfd13417d8ff0a5e1328a50d9&scope.project.id=ceb5cb6c6d8b440688dc3339baa4f642&role.id=1801c155c74646c1a128d958c3f795a4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:28.621106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fd3b-880e-4378-8dc6-90ff8537b0a1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:28.621603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fd3b-880e-4378-8dc6-90ff8537b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:28.621603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5fd3b-880e-4378-8dc6-90ff8537b0a1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:28.622965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 570/1131] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:28.627929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:28.628351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:28.628487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:28.645701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:28.646919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:28.710616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 562/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:28.733431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5fd3b-880e-4378-8dc6-90ff8537b0a1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:28.768966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:28.831116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5fd3b-880e-4378-8dc6-90ff8537b0a1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:28.863424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:28.864187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:28.864465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:28.864732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:28.865879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:28.867878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec172de7-dbe6-4559-aab0-57b7ecfa43b5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:28.869437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 571/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:28.875085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:28.908346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:28.972373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794322ae-cf0b-44c6-bf63-10c9b08df621 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:29.004525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:29.005173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:29.005456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:29.005725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:29.006456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:29.008372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c61b34-14bd-421b-8ad0-0279f11ca0a1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:29.033277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 563/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:15:28 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:31.046892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be63d0-f8e9-456f-a6ca-da13cc9640d5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:31.047448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be63d0-f8e9-456f-a6ca-da13cc9640d5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:31.047448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be63d0-f8e9-456f-a6ca-da13cc9640d5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:31.048807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 572/1135] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:31.053962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:31.054386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:31.054548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:31.071338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:31.072495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:31.135817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 564/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:31.160326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be63d0-f8e9-456f-a6ca-da13cc9640d5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:31.257856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be63d0-f8e9-456f-a6ca-da13cc9640d5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:31.260113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:31.292685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:31.293585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:31.293944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:31.294227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:31.295524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:31.297208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd7b5-8578-472e-91ad-56b0c66390f6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:31.298996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 573/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:31.304879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:31.322653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:31.403105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a911f0-303b-4b6d-a543-a396e785e352 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:31.436017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:31.436673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:31.436952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:31.437227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:31.437942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:31.439375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404877-3991-4b86-a35a-ea8dbbe146d8 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:31.459525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 565/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:15:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:33.531332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5e75-ebc9-4482-a4da-f7c022b480f5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:33.531871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5e75-ebc9-4482-a4da-f7c022b480f5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:33.531871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5e75-ebc9-4482-a4da-f7c022b480f5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:33.533260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 574/1139] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:33.539016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae713e-3386-4895-a08b-6140d83087fa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:33.539432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae713e-3386-4895-a08b-6140d83087fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:33.539579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae713e-3386-4895-a08b-6140d83087fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:33.556681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-feae713e-3386-4895-a08b-6140d83087fa None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:33.557806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-feae713e-3386-4895-a08b-6140d83087fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:33.623147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 566/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:33.646210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a5e75-ebc9-4482-a4da-f7c022b480f5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:33.743230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a5e75-ebc9-4482-a4da-f7c022b480f5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:33.775342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:33.776102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:33.776377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:33.776644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:33.786235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:33.794225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:33.795384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:33.796512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 575/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:33.801496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae713e-3386-4895-a08b-6140d83087fa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:33.803793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:33.900898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae713e-3386-4895-a08b-6140d83087fa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:33.933561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:33.934240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:33.934523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:33.934798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:33.935530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:33.935834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:33.937193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:33.944991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 567/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:33.950926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:33.983659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:34.049595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1667ce5-5030-401c-898c-bb09087e7d30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:34.081218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:34.082090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:34.082370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:34.082638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] PATH_INFO: `/v3/users/49e168c465954739be0aff8e0743e9b3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:34.095660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] RBAC: Authorizing `identity:get_user(user_id=49e168c465954739be0aff8e0743e9b3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:34.097080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:34.098712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 576/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:33 2022] GET /identity/v3/users/49e168c465954739be0aff8e0743e9b3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:34.104458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:34.164930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:34.201598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17015e3-48c9-47a8-a579-f0e52f93f893 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:34.233692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:34.234353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:34.234643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:34.234918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:34.299466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:34.300904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:34.358596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:34.396752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 568/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:34.403187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:34.488486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:34.498717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615aa54-ebf9-4c22-8fed-36477a243a0e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:34.531249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:34.532080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:34.532606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:34.532716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] PATH_INFO: `/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:34.533790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4faeef897e9d4b46b9b630663e2ab2bf)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:34.535238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306186-4686-4bf0-8d9a-d8d0a68474b6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:34.536897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 577/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:34 2022] GET /identity/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:34.543058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:34.640338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d97b4-0e49-4629-bc7b-e8e47c9338e3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:34.672262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:34.672895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:34.673173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:34.673442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:34.674285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=4faeef897e9d4b46b9b630663e2ab2bf, user.id=49e168c465954739be0aff8e0743e9b3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:34.674590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:34.675999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13bd0-16d9-4c2b-ada2-e4ab780018ca None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:34.681749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 569/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:34 2022] GET /identity/v3/role_assignments?user.id=49e168c465954739be0aff8e0743e9b3&scope.project.id=4faeef897e9d4b46b9b630663e2ab2bf&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:36.650277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1ad6-562f-44ce-ad6b-505bf59aeb70 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:36.650772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1ad6-562f-44ce-ad6b-505bf59aeb70 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:36.650772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1ad6-562f-44ce-ad6b-505bf59aeb70 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:36.652113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 578/1147] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:36.657242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:36.657625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:36.657799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:36.674198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:36.675373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:36.698264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:36.740219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 570/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:36.763090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1ad6-562f-44ce-ad6b-505bf59aeb70 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:36.859973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1ad6-562f-44ce-ad6b-505bf59aeb70 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:36.893181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:36.893971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:36.894255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:36.894529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:36.904374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:36.911844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:36.912948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:36.914070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 579/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:36.918973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:37.013693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c69e87-aaab-42d4-a506-7e5b903445d2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:37.047350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:37.048005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:37.048285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:37.048555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:37.049304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:37.049588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:37.050978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:37.059395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 571/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:37.065110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:37.083995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:37.162308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a700-0e8c-417f-8cfe-1919b1707b27 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:37.195008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:37.195856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:37.196139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:37.196415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] PATH_INFO: `/v3/users/49e168c465954739be0aff8e0743e9b3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:37.197587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] RBAC: Authorizing `identity:get_user(user_id=49e168c465954739be0aff8e0743e9b3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:37.199044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:37.200650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 580/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:37 2022] GET /identity/v3/users/49e168c465954739be0aff8e0743e9b3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:37.206423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:37.228434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:37.303474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d30e6-231a-4954-8ee8-7823e3d7a55b None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:37.335762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:37.336608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:37.336889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:37.337164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] PATH_INFO: `/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:37.338350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] RBAC: Authorizing `identity:get_project(project_id=4faeef897e9d4b46b9b630663e2ab2bf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:37.339778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1e507-5e21-4fda-88cb-c13f6e3baf6c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:37.341445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 572/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:37 2022] GET /identity/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:37.348352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:37.432191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:37.446696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb77295-22c3-41ec-ad3d-b1dd3d79be7b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:37.479413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:37.480280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:37.480559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:37.480831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] PATH_INFO: `/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf/users/49e168c465954739be0aff8e0743e9b3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:37.482833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] RBAC: Authorizing `identity:create_grant(project_id=4faeef897e9d4b46b9b630663e2ab2bf, user_id=49e168c465954739be0aff8e0743e9b3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:37.484248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd166-e5be-4178-aa00-da1fc9c41575 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:37.496789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 581/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:15:37 2022] PUT /identity/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf/users/49e168c465954739be0aff8e0743e9b3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:15:39.458710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66880b2-6e75-4289-894b-cedad58547f4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:39.459150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66880b2-6e75-4289-894b-cedad58547f4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:39.459255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66880b2-6e75-4289-894b-cedad58547f4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:39.461195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 573/1154] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:39.466219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:39.466602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:39.466769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:39.482999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:39.484160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:39.554972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 582/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:39.577516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66880b2-6e75-4289-894b-cedad58547f4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:39.664709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:39.677739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66880b2-6e75-4289-894b-cedad58547f4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:39.709888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:39.711229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:39.711510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:39.711785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:39.721558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:39.729657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:39.730769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:39.731788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 574/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:39.736684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:39.809372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:39.832070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c1bec-c2fc-4fa9-a748-5ddbed6a9d1b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:39.864751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:39.865397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:39.865681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:39.865977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:39.866712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:39.867011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:39.868365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:39.876022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 583/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:39.881721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:39.979167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c17f-f562-49df-9bc0-a373f058c371 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:40.011002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:40.011858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:40.012137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:40.012629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] PATH_INFO: `/v3/users/49e168c465954739be0aff8e0743e9b3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:40.014035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] RBAC: Authorizing `identity:get_user(user_id=49e168c465954739be0aff8e0743e9b3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:40.016051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:40.018055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 575/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:39 2022] GET /identity/v3/users/49e168c465954739be0aff8e0743e9b3 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:40.024330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:40.120517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05c706-067d-4544-9d58-dff87612e146 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:40.153308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:40.153966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:40.154253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:40.154531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:40.162693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:40.219493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:40.220927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:40.314967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 584/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:40.321243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:40.339915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:40.419734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee79-5637-45e2-8dbc-f33000dd77e4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:40.454947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:40.455795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:40.456080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:40.456356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] PATH_INFO: `/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:40.457526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] RBAC: Authorizing `identity:get_project(project_id=4faeef897e9d4b46b9b630663e2ab2bf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:40.458992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34c102-a4b4-4060-a3d3-f52843554273 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:40.460684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 576/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:40 2022] GET /identity/v3/projects/4faeef897e9d4b46b9b630663e2ab2bf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:40.466634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:40.512196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:40.570293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3926506-cf98-4d6b-914f-dec8150a6b6e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:40.603018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91636ae-adea-422e-b582-37918571d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:40.603658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91636ae-adea-422e-b582-37918571d51b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:40.603940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91636ae-adea-422e-b582-37918571d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:40.604216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91636ae-adea-422e-b582-37918571d51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:40.605072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91636ae-adea-422e-b582-37918571d51b None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=4faeef897e9d4b46b9b630663e2ab2bf, user.id=49e168c465954739be0aff8e0743e9b3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:40.605386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91636ae-adea-422e-b582-37918571d51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:40.606833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91636ae-adea-422e-b582-37918571d51b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:40.612429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 585/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:40 2022] GET /identity/v3/role_assignments?user.id=49e168c465954739be0aff8e0743e9b3&scope.project.id=4faeef897e9d4b46b9b630663e2ab2bf&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:42.635086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b77d-d81f-4d52-85ec-8df6580492b5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:42.635583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b77d-d81f-4d52-85ec-8df6580492b5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:42.635583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b77d-d81f-4d52-85ec-8df6580492b5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:42.636908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 577/1162] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:42.642302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:42.642727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:42.642854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:42.659709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:42.660883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:42.724578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 586/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:42.747005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b77d-d81f-4d52-85ec-8df6580492b5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:42.829169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:42.845491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b77d-d81f-4d52-85ec-8df6580492b5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:42.878263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:42.878891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:42.879167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:42.879436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:42.943945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:42.945931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:43.024075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:43.040542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 578/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:43.046422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:43.075532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:43.141194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbef-31d2-47b8-b8e7-a3bf4381a715 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:43.173638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:43.174450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:43.174734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:43.175008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:43.182032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:43.183464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-98b2a748-2eb9-4b49-8ef7-a1568ee74986 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:43.197719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:43.203709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:43.204617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 587/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:15:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:43.205406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:43.301147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583bde7-b0a1-4b45-807e-8d421ccc848c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:43.334298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:43.334947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:43.335271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:43.335544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:43.336248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:43.336547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:43.337929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082364d4-ffa2-4cfb-9281-c90f56de83ff None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:43.344864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 579/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 15:15:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:45.330589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b313b-c9fb-468e-aa22-023da9ee5827 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:45.330995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b313b-c9fb-468e-aa22-023da9ee5827 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:45.331141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b313b-c9fb-468e-aa22-023da9ee5827 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:45.332506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 588/1167] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:45.337562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3deb11-2669-4c64-be58-16f7e73797c6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:45.338022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3deb11-2669-4c64-be58-16f7e73797c6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:45.338129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3deb11-2669-4c64-be58-16f7e73797c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:45.355126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5f3deb11-2669-4c64-be58-16f7e73797c6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:45.356282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5f3deb11-2669-4c64-be58-16f7e73797c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:45.398041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:45.420920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 580/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:45.444137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b313b-c9fb-468e-aa22-023da9ee5827 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:45.532352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:45.544135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b313b-c9fb-468e-aa22-023da9ee5827 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:45.576507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:45.577083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:45.577358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:45.577625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:45.578386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:45.579731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bdeca-5639-4f06-a15a-ccfe98a50235 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:45.593418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 589/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Wed Jul 6 15:15:45 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:47.600865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13b01-1922-423a-a400-f1873d46c14f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:47.601365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13b01-1922-423a-a400-f1873d46c14f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:47.601365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db13b01-1922-423a-a400-f1873d46c14f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:47.602714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 581/1170] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:47.607870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:47.608262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:47.608425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:47.624657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:47.625830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:47.689700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 590/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:47.713396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13b01-1922-423a-a400-f1873d46c14f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:47.810454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db13b01-1922-423a-a400-f1873d46c14f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:47.843024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:47.843867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:47.844144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:47.844415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] PATH_INFO: `/v3/domains/0604ab41a4fe4bbda8064d3ba38f9a85` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:47.854429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0604ab41a4fe4bbda8064d3ba38f9a85)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:47.855803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cb8f0-5543-45f7-85ee-eeb9621cca87 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:47.857367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 582/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Jul 6 15:15:47 2022] GET /identity/v3/domains/0604ab41a4fe4bbda8064d3ba38f9a85 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:47.862852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:47.939759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:47.959175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851921-a90d-4f94-b886-9bd1b08ee22f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:47.991990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:47.992639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:47.992919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:47.993193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:47.993887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:47.995338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a95186-b1b1-4be4-b20f-4eee743dd65e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:48.019964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 591/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:15:47 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:50.061211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed870e-98df-4323-a8c4-7e8af6c44bf2 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:50.061760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed870e-98df-4323-a8c4-7e8af6c44bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:50.061760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed870e-98df-4323-a8c4-7e8af6c44bf2 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:50.063131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 583/1174] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:50.068193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:50.068613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:50.068745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:50.085541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:50.086735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:50.150696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 592/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:50.175588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed870e-98df-4323-a8c4-7e8af6c44bf2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:50.215365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:50.274597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed870e-98df-4323-a8c4-7e8af6c44bf2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:50.310235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:50.311094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:50.311424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:50.311648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] PATH_INFO: `/v3/domains/0604ab41a4fe4bbda8064d3ba38f9a85` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:50.312809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0604ab41a4fe4bbda8064d3ba38f9a85)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:50.314295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566611ac-4783-4b6f-a3dc-529fed9265c5 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:50.315900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 584/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Jul 6 15:15:50 2022] GET /identity/v3/domains/0604ab41a4fe4bbda8064d3ba38f9a85 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:50.321801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:50.380753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:50.418082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45c9e-7a4c-43ed-b8ba-8336ded73466 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:50.450102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:50.450750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:50.451032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:50.451306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:50.452012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:50.453426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08558-b880-4fd6-91d0-750edf7109bb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:50.472456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 593/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:15:50 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:15:52.510581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af4c-0c2e-4793-a8c3-028d4e105ad9 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:52.511125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af4c-0c2e-4793-a8c3-028d4e105ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:52.511125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af4c-0c2e-4793-a8c3-028d4e105ad9 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:52.512462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 585/1178] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:52.519195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:52.519614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:52.519754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:52.536084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:52.537266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:52.600912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 594/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:52.624195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0af4c-0c2e-4793-a8c3-028d4e105ad9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:52.721386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0af4c-0c2e-4793-a8c3-028d4e105ad9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:52.728484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:52.754680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:52.755454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:52.755734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:52.756007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:52.766784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:52.774216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:52.775307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:52.776170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 586/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:52.781157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:52.829120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:52.877775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ac7a-889e-4ced-914e-949df434ab48 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:52.909534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:52.910210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:52.910487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:52.910753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:52.911481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:52.911779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:52.913663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:52.921343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 595/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:52.927057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:53.023658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012ae69-7289-4889-b0e1-ba3a5b3739ec None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:53.056513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:53.057357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:53.057641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:53.057937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] PATH_INFO: `/v3/users/d7c4b958c8d84fa187b4fc609e9248c3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:53.070655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c4b958c8d84fa187b4fc609e9248c3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:53.072101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:53.073739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 587/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:52 2022] GET /identity/v3/users/d7c4b958c8d84fa187b4fc609e9248c3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:53.079356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:53.174278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3615-9d0f-45a4-93fd-4ff4b6f4c313 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:53.186240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:53.206080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:53.206710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:53.206990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:53.207263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:53.273193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:53.274712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:53.369729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 596/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:53.375715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:53.411361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:53.483535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408285bc-7685-49e7-83ce-cc841031bcb1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:53.516447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:53.517288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:53.517568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:53.517835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] PATH_INFO: `/v3/projects/0a602ba966094d56868948930f9e1336` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:53.519015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] RBAC: Authorizing `identity:get_project(project_id=0a602ba966094d56868948930f9e1336)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:53.520455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ac93c-421d-4483-8adb-a3174bb58d50 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:53.522159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 588/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:53 2022] GET /identity/v3/projects/0a602ba966094d56868948930f9e1336 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:53.528608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:53.542236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:53.622376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bdad-a977-4c97-9973-d3a4cde0704a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:53.655422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:53.656062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:53.656342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:53.656615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:53.657438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=0a602ba966094d56868948930f9e1336, user.id=d7c4b958c8d84fa187b4fc609e9248c3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:53.657747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:53.659210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2733ab5-5ccf-4f66-9d29-0aa08193633f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:53.664426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 597/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:53 2022] GET /identity/v3/role_assignments?user.id=d7c4b958c8d84fa187b4fc609e9248c3&scope.project.id=0a602ba966094d56868948930f9e1336&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:55.615112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16b53-7be6-4ded-b45a-3f8343fc2909 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:55.615621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16b53-7be6-4ded-b45a-3f8343fc2909 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:55.615621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16b53-7be6-4ded-b45a-3f8343fc2909 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:55.617478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 589/1186] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:55.622559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:55.622976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:55.623107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:55.640170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:55.641325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:55.704280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 598/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:55.725976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16b53-7be6-4ded-b45a-3f8343fc2909 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:55.815446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:55.825602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16b53-7be6-4ded-b45a-3f8343fc2909 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:55.857843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:55.858643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:55.858922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:55.859189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:55.869583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:55.877008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:55.878217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:15:55.879158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 590/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:55.884418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:55.892652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:55.981886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e781-fdb2-4f5f-b39b-c7d8b49f3875 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:56.013938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:56.014854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:56.015131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:56.015402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:56.016132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:56.016431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:56.017808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:56.025951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 599/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:56.031765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:56.128905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7618487-a29e-44be-9ff1-87a1962e37ff None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:56.161193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:56.162075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:56.162359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:56.162632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] PATH_INFO: `/v3/users/d7c4b958c8d84fa187b4fc609e9248c3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:56.164351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] RBAC: Authorizing `identity:get_user(user_id=d7c4b958c8d84fa187b4fc609e9248c3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:56.165775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:56.167390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 591/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:56 2022] GET /identity/v3/users/d7c4b958c8d84fa187b4fc609e9248c3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:56.173174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:56.236311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:56.268785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c48134-e38d-4c9f-b157-e1f235563974 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:56.302025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:56.302886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:56.303167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:56.303533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] PATH_INFO: `/v3/projects/0a602ba966094d56868948930f9e1336` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:56.304718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] RBAC: Authorizing `identity:get_project(project_id=0a602ba966094d56868948930f9e1336)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:56.306193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6832e10-34c0-46a0-91c4-da582b7a8795 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:56.307849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 600/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:56 2022] GET /identity/v3/projects/0a602ba966094d56868948930f9e1336 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:56.313619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:56.336374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:56.411275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe3b5-85d2-44e0-90a6-6cdc0b04006c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:56.443072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:56.443938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:56.444214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:56.444484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] PATH_INFO: `/v3/projects/0a602ba966094d56868948930f9e1336/users/d7c4b958c8d84fa187b4fc609e9248c3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:56.446435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a602ba966094d56868948930f9e1336, user_id=d7c4b958c8d84fa187b4fc609e9248c3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:56.447850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c96a-5d4f-4876-b730-002753749560 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:56.460468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 592/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:15:56 2022] PUT /identity/v3/projects/0a602ba966094d56868948930f9e1336/users/d7c4b958c8d84fa187b4fc609e9248c3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:15:58.438595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796395-6fd5-4acc-81de-53d88b9780ef None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:58.439134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796395-6fd5-4acc-81de-53d88b9780ef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:58.439134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796395-6fd5-4acc-81de-53d88b9780ef None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:58.440520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 601/1193] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:15:58.446187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:58.446614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:58.446744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:58.463268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:15:58.464444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:15:58.528342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 593/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:15:58.551489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796395-6fd5-4acc-81de-53d88b9780ef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:58.649259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796395-6fd5-4acc-81de-53d88b9780ef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:58.681913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:58.682698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:58.682975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:58.683243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:58.685751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:58.693767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:15:58.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:15:58.702997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:15:58.704025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 602/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:15:58.709059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:58.720379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:58.805807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c9ae-cb2f-4d21-887b-025d8deab793 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:58.837709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:58.838399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:58.838681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:58.838955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:58.839687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:58.839989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:58.841349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:58.849078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 594/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:58.855100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:58.950513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f247c-9f44-4f49-a974-c4db64db9179 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:58.982037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:58.982878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:58.983153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:58.983421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] PATH_INFO: `/v3/users/d7c4b958c8d84fa187b4fc609e9248c3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:58.984576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c4b958c8d84fa187b4fc609e9248c3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:58.986015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:58.987599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 603/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 15:15:58 2022] GET /identity/v3/users/d7c4b958c8d84fa187b4fc609e9248c3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:58.993656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:59.062489 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:59.090666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a2dd8-1d1b-440a-af73-46bec3593838 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:59.123101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:59.123736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:59.124017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:59.124291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:59.188491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:59.189945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:59.254514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:59.284039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 595/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:15:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:15:59.290394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:59.350110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:15:59.387692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6a8f-7e02-4925-bffd-d0c2d422b908 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:59.420743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:59.421590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:59.421872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:59.422178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] PATH_INFO: `/v3/projects/0a602ba966094d56868948930f9e1336` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:59.423357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] RBAC: Authorizing `identity:get_project(project_id=0a602ba966094d56868948930f9e1336)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:59.424783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17b07-f54e-4cfb-aa31-89bed6377898 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:59.426512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 604/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 15:15:59 2022] GET /identity/v3/projects/0a602ba966094d56868948930f9e1336 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:15:59.432806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:15:59.529174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c3f4-7eb2-449d-84b4-1ecf0eeb5dc7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:15:59.562334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:15:59.562977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:15:59.563258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:15:59.563529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:15:59.564346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=0a602ba966094d56868948930f9e1336, user.id=d7c4b958c8d84fa187b4fc609e9248c3) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:15:59.564654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:15:59.566087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9a8c-dd6d-4f27-af65-e657a9c7fda3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:15:59.572253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 596/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:15:59 2022] GET /identity/v3/role_assignments?user.id=d7c4b958c8d84fa187b4fc609e9248c3&scope.project.id=0a602ba966094d56868948930f9e1336&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:16:09.416706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=34 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:09.569241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=82 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:54.231984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda7ac-82c4-4138-8260-ff06542c1108 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:54.232678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda7ac-82c4-4138-8260-ff06542c1108 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:54.232678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda7ac-82c4-4138-8260-ff06542c1108 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:54.234129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 605/1201] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:16:54.239971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:54.240457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:54.240578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:54.259449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:16:54.260908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:16:54.352482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 597/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:16:54.377146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fda7ac-82c4-4138-8260-ff06542c1108 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:54.511696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fda7ac-82c4-4138-8260-ff06542c1108 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:54.553827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:54.554637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:54.554918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:54.555193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:54.568244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:54.570326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:16:54.602967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:54.604131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:54.605197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:16:54.605197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:16:54.605197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:54.605197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:16:54.605852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 606/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:16:54.611510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:54.745941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bfc1f-0025-4d09-9fc0-cc11cfb9a3fc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:54.793426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:54.803774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:54.804847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:54.805305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:54.805734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:54.806992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:54.807522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:54.810100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280280e-1445-4f59-ac89-260a9c8439da None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:54.834032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 598/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:16:54.838936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:54.909270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:54.980212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e61-975d-4859-bd1c-998b25b21e84 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:55.026894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:55.027975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:55.028434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:55.028882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:55.029439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:55.031015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f093f-4016-4666-a49a-5f06b225e794 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:55.070043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 607/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 15:16:54 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:16:57.295083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa65e4-1a0f-43d8-9955-897906b6085b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:57.295771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa65e4-1a0f-43d8-9955-897906b6085b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:57.295771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa65e4-1a0f-43d8-9955-897906b6085b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:57.297136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 599/1206] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:16:57.305587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:57.305587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:57.305587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:57.330170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:16:57.332247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:16:57.416843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 608/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:16:57.444500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa65e4-1a0f-43d8-9955-897906b6085b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:57.581125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa65e4-1a0f-43d8-9955-897906b6085b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:57.620321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:57.621117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:57.621401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:57.621673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:57.634767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:16:57.642773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:57.644387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:16:57.646017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 600/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:16:57.651067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:57.694714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:57.761421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19028908-ffc0-41c9-994d-3f68b2ef4431 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:57.802720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:57.803775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:57.804061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:57.804340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:57.805121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:57.805430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:57.806830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:57.823599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 609/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:16:57.824810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:57.884540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:57.946245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102dc6b-b309-438d-bf90-e2666b7de521 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:57.990450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:57.991340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:57.991736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:57.992082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:58.003158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:58.005374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:16:58.023559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:58.025066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:58.026319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:16:58.026319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:16:58.026319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:58.026319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:16:58.026747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 601/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:16:58.033382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:58.155228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:58.158466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0945c3-5879-40c1-abf4-7128c47d26d3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:58.197315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:58.198118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:58.203722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:58.204691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:58.205609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:58.206032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:58.207583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:58.221884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 610/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:16:58.228870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:58.360584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d03284-eb9f-49d2-8200-90e74cd165c0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:58.363113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:58.405958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:58.406917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:58.407401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:58.407900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:58.417654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:58.419190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:16:58.435401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:58.436466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:16:58.437415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:16:58.441429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 602/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:16:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:16:58.443479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:58.569670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bebdd4-fa7f-4342-9e14-be311d28365f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:58.616276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:58.616966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:58.617252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:58.617529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:58.618420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:58.618730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:58.620226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:58.642356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 611/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:16:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:16:58.649771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:58.772692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f86215-0180-4e3a-a57f-63d21717f4f3 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:58.816410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:58.817703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:58.818020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:58.818302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:58.851117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:58.898383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:58.900276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.019284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 603/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:16:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:16:59.026041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:59.052460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:59.143409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840a5e0-2f05-4b41-ad0e-8cdd0adb8ad3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:59.178289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:59.179077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:59.179354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:59.179705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:59.190570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:59.192128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:16:59.211443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:59.212407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:59.214093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:16:59.214093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:16:59.214093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:16:59.214093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:16:59.214093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 612/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:16:59.219543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:59.289437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:59.329401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1619f5-5592-4875-99c9-9f3fb565c7b1 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:59.369141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:59.369827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:59.370105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:59.370375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:59.371094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:59.371394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:59.372757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.389802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 604/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:16:59.390723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:59.468575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:59.508304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4957d5-b651-4538-b0de-617c82151e13 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:59.546099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:59.546896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:59.547182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:59.547452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:59.555839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:59.557410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:16:59.573192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:16:59.574468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:16:59.575945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 613/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:16:59.580508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:59.688200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ba84-7758-4c06-8d8a-2a0dbc7b5163 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:59.714787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:59.730522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:59.731279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:59.731628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:59.731968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:59.732830 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:59.733212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:59.734824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26c9e-7dc8-48f4-a2aa-c73f86625a32 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.750533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 605/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:16:59.757324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:16:59.880877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2bb9-a657-46da-93cd-83ee7559ec11 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:16:59.916345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:16:59.923857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:16:59.924580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:16:59.924967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:16:59.925341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:16:59.926314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=e61587f7080b4cbcb3e906efaf4cb894) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:16:59.926820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:16:59.928351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af796fd2-55aa-43b1-bf01-ecec882b0369 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:16:59.935135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 614/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:16:59 2022] GET /identity/v3/role_assignments?user.id=e61587f7080b4cbcb3e906efaf4cb894&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:02.042715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bcb0-d83f-460a-a123-77b33ba1c560 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.043270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bcb0-d83f-460a-a123-77b33ba1c560 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.043270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bcb0-d83f-460a-a123-77b33ba1c560 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.044691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 606/1220] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:02.050635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.051085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.051254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.072312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:02.074393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:02.152668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 615/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:02.178124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bcb0-d83f-460a-a123-77b33ba1c560 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:02.286640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bcb0-d83f-460a-a123-77b33ba1c560 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:02.328780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:02.329642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.330006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.330324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.341990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:17:02.350632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:02.351765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:02.352930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 607/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:02.358023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:02.456262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bef66-b0cb-489f-8a13-3d7e4f920adb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:02.480624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:02.492398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:02.493189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.493538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.493915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.494768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:02.495071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:02.496545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:02.505513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 616/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:02.511251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:02.560896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:02.621556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecbb96-035a-438a-a749-115e18d2af22 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:02.656355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:02.657140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.657418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.657685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.668109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:02.669552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:02.686866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:02.688417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:02.689752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:02.689752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:02.689752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:02.689752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:02.689752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 608/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:02.694614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:02.803996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9dbb2-02ea-42c6-adfd-fe985d7308e2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:02.839814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:02.840407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:02.840718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:02.840965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:02.841729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:02.842068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:02.843434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:02.855245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 617/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:02.861059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:02.959855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:02.968049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7485-4ea2-4ad4-a607-e0dfdd8891ad None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.005881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.007009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.007499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.007977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.018560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.020006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:17:03.037947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:03.039137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:03.040331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 609/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:03.045407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.101683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:03.159096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ece850-265f-48a3-b2d6-c460b2c32ee4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.196539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.197208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.197493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.197771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.198712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:03.199043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.200444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.219351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 618/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:03.225477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.332388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc154b-cba4-4665-bbab-9cf240b72323 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.366728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.367447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.367733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.368007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.379070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.384544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:03.404041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:03.404999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:03.405933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:03.405933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:03.405933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:03.405933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:03.405933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 610/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:03.412341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.525482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2937-6bdc-4299-a2d3-b5fb6c5d98a8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.527894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:03.562011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.562686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.562961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.563261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.563983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:03.564271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.565636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.577121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 619/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:03.583024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.592646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:03.692352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1a2b9-15af-4b0b-961f-a9b6741c82a2 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.727897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.728688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.728968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.729237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.736293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.737912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:17:03.751728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:03.752945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:03.754232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 611/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:03.758913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.862177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84432a-5cde-4901-bfc4-378091e0f3b6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:03.896775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:03.897458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:03.897774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:03.898119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:03.898890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:03.899192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:03.900674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b5b9-853f-4f53-bcb2-f1985922ca8c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:03.913355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 620/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:03.919621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:03.992468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:04.030399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb862-96c0-4c6f-9d50-9c3beecc5f7c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:04.078163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:04.079424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:04.079970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:04.080502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/e61587f7080b4cbcb3e906efaf4cb894/roles/05d0bb26247a4dd48c2cf6be8b0d3eac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:04.100223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=e61587f7080b4cbcb3e906efaf4cb894, role_id=05d0bb26247a4dd48c2cf6be8b0d3eac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:04.101682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a99166-f904-477b-977c-c49c00530c40 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:04.114203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 612/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:17:03 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/e61587f7080b4cbcb3e906efaf4cb894/roles/05d0bb26247a4dd48c2cf6be8b0d3eac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:17:06.315971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef54-8943-4db6-a335-1de9c732fe71 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:06.316524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef54-8943-4db6-a335-1de9c732fe71 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:06.316628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef54-8943-4db6-a335-1de9c732fe71 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:06.318751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 621/1233] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:06.324764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:06.325213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:06.325457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:06.345933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:06.347159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:06.418451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 613/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:06.443552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fef54-8943-4db6-a335-1de9c732fe71 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:06.471237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:06.557393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fef54-8943-4db6-a335-1de9c732fe71 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:06.594453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:06.595942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:06.596216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:06.596498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:06.607563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:17:06.615339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:06.616507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:06.617445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 622/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 15:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:06.622781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:06.674484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:06.733463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e56d-ebf0-4654-b00b-9b03b02432b1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:06.772422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:06.773087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:06.773366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:06.773635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:06.774404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:06.774703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:06.776087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:06.784240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 614/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 15:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:06.791039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:06.882717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:06.903754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391adf9-e89a-4c67-b434-e7544743d3db None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:06.943114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:06.943915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:06.944200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:06.944478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:06.955734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:06.957154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:06.978208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:06.979354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:06.980616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:06.980616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:06.980616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:06.980616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:06.980616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 623/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:17:06.985983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:07.099337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525898-8b1e-49de-896b-b582ce2e9b99 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:07.109557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:07.138870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:07.139474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:07.139759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:07.140033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:07.140787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:07.141090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:07.142531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:07.155690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 615/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:07.162640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:07.272485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17b06e-e9e3-4b70-a3d0-15bae3d26377 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:07.309776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:07.310636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:07.310957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:07.314305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:07.318499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:07.324239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:07.326003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:17:07.341920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:07.343200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:07.344290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 624/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:07.350378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:07.464532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005684cb-cbcf-4f23-8736-adbb47e93bef None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:07.503646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:07.504936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:07.505219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:07.505492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:07.506356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:07.506662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:07.508148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:07.526113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 616/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:17:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:07.531906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:07.637012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6fb3-5251-45ab-a3d1-e2d3c289be64 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:07.673592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:07.674314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:07.674617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:07.674860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:07.744428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:07.751473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:07.752943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:07.871105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 625/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:17:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:07.877098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:07.907852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:07.987863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f616e9-f41a-46c6-9206-552ad779c21a None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:08.028756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:08.029461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:08.029753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:08.030064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:08.042443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:08.044169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:08.068483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:08.069806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:08.071203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:08.071203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:08.071203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:08.071203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:08.071203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 617/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:08.076421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:08.187076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:08.193839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161508f5-6e42-4a9c-b920-474849bd8a8c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:08.230944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:08.231606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:08.231968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:08.232247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:08.233116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:08.233405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:08.234812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:08.246874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 626/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:08.253669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:08.344614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:08.368600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab80add-448d-4747-8f7e-599127142fcd None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:08.414927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:08.415831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:08.416139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:08.416515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:08.424086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:08.425529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:17:08.439497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:08.440618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:08.441657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 618/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:08.447369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:08.565236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01da04-0c68-49d0-a14e-df8e43c09ce8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:08.602221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:08.602926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:08.603173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:08.603448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:08.604238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:08.604547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:08.606012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76b2a-14e0-4653-b839-8a1d225fb819 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:08.619013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 627/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:08.626078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:08.729716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaf9d0-50e6-41e7-b9f8-bcf6af14f083 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:08.765839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:08.766528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:08.766810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:08.767104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:08.767970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] RBAC: Adding query filter params (role.id=05d0bb26247a4dd48c2cf6be8b0d3eac, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=e61587f7080b4cbcb3e906efaf4cb894) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:08.768289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:08.769718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269f0c9-926c-4959-99a5-f049f018b3b7 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:08.777739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 619/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:17:08 2022] GET /identity/v3/role_assignments?user.id=e61587f7080b4cbcb3e906efaf4cb894&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=05d0bb26247a4dd48c2cf6be8b0d3eac => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:11.198239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1f78-e6e6-469c-a30b-1f4a3b89c3e1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:11.198803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1f78-e6e6-469c-a30b-1f4a3b89c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:11.198922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1f78-e6e6-469c-a30b-1f4a3b89c3e1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:11.201930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 628/1247] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:11.205839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:11.206329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:11.206438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:11.212097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:11.225670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:11.226985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:11.300348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 620/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:11.325155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1f78-e6e6-469c-a30b-1f4a3b89c3e1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:11.345590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:11.446168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1f78-e6e6-469c-a30b-1f4a3b89c3e1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:11.484067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:11.484893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:11.485191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:11.485466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:11.500080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:17:11.512561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:11.514022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:11.515054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 629/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:11.522769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:11.638040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b50d2-fb5b-4e95-8fc9-827b9ebc01cd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:11.670798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:11.676037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:11.677551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:11.677887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:11.678195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:11.678944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:11.679892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:11.681317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:11.689728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 621/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:11.696016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:11.793392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:11.821563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d8d1-17e6-4ec7-aa8d-f9569ec2d721 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:11.858891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:11.859688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:11.859974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:11.860259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:11.872037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:11.873588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:11.892059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:11.893296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:11.894361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:11.894361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:11.894361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:11.894361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:11.894361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 630/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:11.900352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:12.009856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1d69e-c181-491a-9090-cfed9307f08f None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:12.047224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:12.048921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:12.048921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:12.048921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:12.049835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:12.050219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:12.052724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:12.068001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 622/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:12.074262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:12.191469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea40c4-4ebe-44b0-837f-3535e27e9815 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:12.217509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:12.226959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:12.227763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:12.228042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:12.228313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:12.236082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:12.237559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:17:12.252707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:12.253789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:12.255880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 631/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:12.260229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:12.324293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:12.377282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf913-7951-4c17-b991-44c9af8f3a07 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:12.414651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:12.415324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:12.415614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:12.415891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:12.416725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:12.417031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:12.418505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:12.442427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 623/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:17:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:12.443933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:12.556151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a926c-e186-4f30-b246-b8ab5f5cd85d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:12.596661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:12.597452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:12.597642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:12.597963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:12.654618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:12.667503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:12.668968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:12.769568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 632/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:17:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:12.775533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:12.890061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e57d9f-abf5-4c4d-b07e-c4958a38399d None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:12.906377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:12.929034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:12.929980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:12.930234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:12.930508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:12.941131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:12.943365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:12.961346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:12.962501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:12.963393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:12.963393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:12.963393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:12.963393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:12.963393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 624/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 15:17:12.969012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:13.061594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:13.075342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a53b-0f63-48a1-8c1c-4e571b42b7f9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:13.112179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:13.112836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:13.113154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:13.113428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:13.114729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:13.115066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:13.116570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:13.128166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 633/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:13.134330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:13.244189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fe7a-6152-47e6-92ee-8610b416bbb4 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:13.283771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:13.284577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:13.284865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:13.285145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:13.292869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:13.294502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:17:13.308711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:13.309689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:13.310967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 625/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:13.316308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:13.426100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3046-13b3-4f8f-9ff7-eab9bb3c8f7b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:13.462411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:13.463076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:13.463361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:13.463636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:13.464433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:13.464746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:13.466236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cea7c-26bc-4a4f-bc0f-dce0ab386f38 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:13.478828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 634/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:13.485072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:13.512987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:13.593246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d94be2-0b15-4407-8136-00ea571c4260 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:13.630322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:13.630997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:13.631277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:13.631550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:13.632393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=e61587f7080b4cbcb3e906efaf4cb894) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:13.632710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:13.634196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555fd7b-b39a-4fbd-96fa-71f49b980432 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:13.640886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 626/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:17:13 2022] GET /identity/v3/role_assignments?user.id=e61587f7080b4cbcb3e906efaf4cb894&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:15.666388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b812-cadc-4150-9f4d-e396ab149f99 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:15.666897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b812-cadc-4150-9f4d-e396ab149f99 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:15.666897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5b812-cadc-4150-9f4d-e396ab149f99 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:15.668226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 635/1261] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:15.673440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:15.673854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:15.674029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:15.690404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:15.691583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:15.756314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 627/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:15.778666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5b812-cadc-4150-9f4d-e396ab149f99 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:15.789832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:15.877029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5b812-cadc-4150-9f4d-e396ab149f99 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:15.909572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:15.910985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:15.911271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:15.911543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:15.921227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:17:15.929395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:15.930528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:15.931561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 636/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:15.936655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:15.954913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:16.032427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdda3f-865f-432f-a7e2-ab2ca653b606 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.076474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.077142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.077440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.077702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.078502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:16.078811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.080264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.088581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 628/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:16.096105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:16.162972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:16.195864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0f49-6d52-4e55-ab18-ab175e965eb5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.227741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.228511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.228791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.229063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.239668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.241113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:16.257875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:16.258950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:16.260074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:16.260074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:16.260074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:16.260074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:16.260074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 637/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:16.265220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:16.345129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:16.365029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55890ff-1185-43b2-95f0-c8a08c8d8912 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.398125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.398783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.399066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.399346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.400085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:16.400388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.401751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.413772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 629/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:16.419642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:16.516581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403b26-9b5d-4a9b-a98e-993fb81c0749 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.536260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:16.549917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.550705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.553026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.553026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.559439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.560881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:17:16.575345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:16.576415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:16.577688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 638/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:16.582360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:16.678448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46486-064e-441d-bcf5-c25d6d0b3bf6 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.711388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.712040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.712323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.712597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.713421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:16.713727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.715177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.724346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:16.733642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 630/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:16.740255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:16.837160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5727d-cd7a-40c4-8dc1-f21fed6213ef None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:16.870235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:16.871001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:16.871285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:16.871564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:16.882310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:16.883744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:16.901113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:16.902008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:16.902914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:16.902914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:16.902914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:16.902914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:16.902914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 639/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:16.907875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:17.001672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194213-18b2-48ed-89da-83ae558d6f27 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:17.035559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:17.036212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:17.036595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:17.036905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:17.037706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:17.038130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:17.039581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:17.051536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 631/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:17.057771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:17.092133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:17.157526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f095-1b7f-4c22-868e-247e818e21c2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:17.190441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:17.191223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:17.191510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:17.192302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:17.199250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:17.200793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:17:17.214844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:17.215863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:17.217116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 640/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:17.221841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:17.279274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:17.320685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83fbbf-12f9-483a-98b9-b918ee979b9c None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:17.352068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:17.352660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:17.352938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:17.353209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:17.354010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:17.354315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:17.355748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a4f6-043f-489c-b051-8ab3cf81f496 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:17.367710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 632/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:17.373607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:17.461210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:17.470287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f01d23-99fa-484a-abfe-76a850449862 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:17.502655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:17.503518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:17.503797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:17.504621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] PATH_INFO: `/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/e61587f7080b4cbcb3e906efaf4cb894/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:17.506634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8d976e6635e44dd9faaeeeb1631558f, user_id=e61587f7080b4cbcb3e906efaf4cb894, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:17.508064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fabb-7de9-4fb8-b88f-9f084a430196 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:17.520362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 641/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 15:17:17 2022] PUT /identity/v3/projects/e8d976e6635e44dd9faaeeeb1631558f/users/e61587f7080b4cbcb3e906efaf4cb894/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:17:19.487417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337937-fdb5-45b1-a43a-7ce18a1cfe1c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:19.487955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337937-fdb5-45b1-a43a-7ce18a1cfe1c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:19.487955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337937-fdb5-45b1-a43a-7ce18a1cfe1c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:19.489832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 633/1274] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:19.494927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:19.495294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:19.495485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:19.512260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:19.513695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:19.578549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 642/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:19.601519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337937-fdb5-45b1-a43a-7ce18a1cfe1c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:19.700192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337937-fdb5-45b1-a43a-7ce18a1cfe1c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:19.716566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:19.732854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:19.733633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:19.733938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:19.734218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:19.744534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 15:17:19.751995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:19.753068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:19.754709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 634/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 15:17:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:19.759550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:19.836436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:19.854691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7d230-3b41-4e6d-97d8-b77fa9f7ad60 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:19.886767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:19.887420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:19.887700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:19.887972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:19.888957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:19.889255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:19.890641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:19.898326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 643/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 15:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:19.903782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.001664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a68ef-2f0d-4d60-8b71-16f5ce3f9cf7 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.034133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.034907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.035189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.035965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.046356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.047816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:20.065081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:20.066171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:20.067823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:20.067823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:20.067823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:20.067823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:20.067823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 635/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:20.072797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.168403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb202e3-7f69-4c72-9765-a2799443a10b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.200948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.201589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.201872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.202182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.202895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:20.203206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.204562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.215920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 644/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:20.221245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.251275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:20.322297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df2549-d5ea-4308-8928-8ba75906a8af None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.354492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.355284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.355566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.355841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.363108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.365084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 15:17:20.378989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:20.380548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:20.381559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 636/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:20.386424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.390449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:20.482956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce83ad-9679-4a17-8555-30d25b041959 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.516409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.517067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.517348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.517623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.518479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:20.518784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.520256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.537068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 645/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 15:17:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:20.542715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.630540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:20.640523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf37e-e37e-45db-9468-c47f4be9c677 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.673070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.673706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.674020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.674299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.739229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.740596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.824937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:20.834929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 637/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 15:17:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 15:17:20.840698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:20.899780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:20.936438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23ecb-1b0f-47df-ac58-eeff25078836 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:20.969213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:20.970011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:20.970294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:20.970570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:20.980805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:20.982279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 15:17:20.999080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:21.000095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:21.001254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 15:17:21.001254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 15:17:21.001254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 15:17:21.001254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:21.001254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 646/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:21.006041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:21.109524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544a003-c4b0-40d6-84f0-8ab4e4c61854 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:21.142177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:21.142839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:21.143121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:21.143397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:21.144112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:21.144418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:21.146339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:21.157172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 638/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 15:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:21.163424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:21.259690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5497d-da1f-4bc2-b3cb-90488980e6ed None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:21.273647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:21.293378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:21.294187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:21.294470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:21.294745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:21.301242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:21.302719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 15:17:21.316003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:21.317603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: ERROR keystone.server.flask.application Jul 06 15:17:21.318733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 647/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 15:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:21.323488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:21.372201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:21.420823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc510b9-131a-4759-865d-4d33aec6f5c0 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:21.452757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:21.453395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:21.453673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:21.453966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:21.454737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:21.455038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:21.456477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d10c-35aa-4ffd-bb7b-9282dbfdb2af None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:21.468584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 639/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 15:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:21.474718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:21.571692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e494e-6e67-458a-b43d-5fb4974ae2f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:21.605078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:21.605710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:21.606024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:21.606302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:21.607122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] RBAC: Adding query filter params (role.id=ad052cc0d669492da50cd35179f4ce54, scope.project.id=e8d976e6635e44dd9faaeeeb1631558f, user.id=e61587f7080b4cbcb3e906efaf4cb894) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:21.607430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:21.608849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08ac6-0598-41b3-9047-6ad0e46cec73 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:21.614853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 648/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 15:17:21 2022] GET /identity/v3/role_assignments?user.id=e61587f7080b4cbcb3e906efaf4cb894&scope.project.id=e8d976e6635e44dd9faaeeeb1631558f&role.id=ad052cc0d669492da50cd35179f4ce54 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:23.614261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9a25-2211-450f-abd0-7ec4ccafa2d4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:23.614775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9a25-2211-450f-abd0-7ec4ccafa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:23.614775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9a25-2211-450f-abd0-7ec4ccafa2d4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:23.616068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 640/1288] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:23.621238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:23.621627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:23.621803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:23.639076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:23.640255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:23.670524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:23.706432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 649/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:23.728945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e9a25-2211-450f-abd0-7ec4ccafa2d4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:23.827757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e9a25-2211-450f-abd0-7ec4ccafa2d4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:23.837884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:23.860817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:23.861595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:23.861881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:23.862179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:23.862820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:23.864827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:23.876328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:23.877532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:23.878796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 641/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:17:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:23.883292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:23.978721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27a9bf-2388-4ac2-aa76-e8d280cc98d8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:24.010023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:24.010668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:24.010946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:24.011218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:24.011908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:24.012206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:24.013815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f5195-d410-4ef9-9c82-8da33fb47a3e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:24.018472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 650/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 15:17:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:17:24.024488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:24.136462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad464-988c-4e42-b5b5-fab086378890 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:24.169123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:24.169769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:24.170077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:24.170349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] PATH_INFO: `/v3/services` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:24.171065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:24.171362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:24.172717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e93998-f142-45cc-8d3c-404a6db04f92 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:24.177064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 642/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 15:17:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:26.171615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673565-faea-499b-a0ee-2a27a50dfa39 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:26.172308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673565-faea-499b-a0ee-2a27a50dfa39 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:26.172308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673565-faea-499b-a0ee-2a27a50dfa39 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:26.173563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 651/1293] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:26.179155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1262-3052-42d6-b1d5-97ad27993679 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:26.179658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1262-3052-42d6-b1d5-97ad27993679 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:26.179764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b1262-3052-42d6-b1d5-97ad27993679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:26.196682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5b0b1262-3052-42d6-b1d5-97ad27993679 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:26.197859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5b0b1262-3052-42d6-b1d5-97ad27993679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:26.227534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:26.263798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 643/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:26.286910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673565-faea-499b-a0ee-2a27a50dfa39 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:26.316542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:26.384554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673565-faea-499b-a0ee-2a27a50dfa39 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:26.417754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:26.418423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:26.418701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:26.418972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:26.419686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:26.421038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c449dc-8868-4a8c-bfba-383976d391ba None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:26.433657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 652/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 15:17:26 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:17:28.442549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6fb6-b9f5-44cc-9a09-e09f0120b4e6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:28.443059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6fb6-b9f5-44cc-9a09-e09f0120b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:28.443173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6fb6-b9f5-44cc-9a09-e09f0120b4e6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:28.444444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 644/1296] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:28.449583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:28.450014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:28.450218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:28.466811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:28.468005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:28.537515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 653/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:28.560924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6fb6-b9f5-44cc-9a09-e09f0120b4e6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:28.658219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6fb6-b9f5-44cc-9a09-e09f0120b4e6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:28.692081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:28.692855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:28.693128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:28.693393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:28.694058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:28.695407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:28.706811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:28.708047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:28.709387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 645/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:17:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:28.713960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:28.731724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:28.812644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f5992-c5b9-49b8-a21d-e275621c08db None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:28.844418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:28.845070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:28.845353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:28.845629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:28.846354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:28.846658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:28.848537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:28.853507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 654/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 15:17:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:28.859355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:28.890883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:28.957101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c11d29-bfa7-46a8-bb6f-2925309ae225 None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:28.990105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:28.990741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:28.991026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:28.991304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:28.992081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] RBAC: Adding query filter params (interface=public, service_id=e972dc2535f643cabb2d88eb92f98134, region_id=RegionOne) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:28.992393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:28.993757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed713a-a786-4c79-a211-9e17379ab982 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:28.998688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 646/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 15:17:28 2022] GET /identity/v3/endpoints?service_id=e972dc2535f643cabb2d88eb92f98134&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:29.004193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:29.090104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:29.110118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe878-6bb1-4473-83fe-d5ac3fb5b8a6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:29.143785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:29.144933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:29.145212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:29.145483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:29.146180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:29.147538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f94bb-6243-476f-9d13-72328e8ba3f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:29.154216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 655/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 15:17:29 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:17:31.133117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3241c-290b-46c3-9a36-5734e630d974 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:31.133674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3241c-290b-46c3-9a36-5734e630d974 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:31.133674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3241c-290b-46c3-9a36-5734e630d974 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:31.135043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 647/1302] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:17:31.140247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:31.140658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:31.140803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:31.156977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:17:31.158161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:17:31.221839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 656/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:17:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 15:17:31.245078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3241c-290b-46c3-9a36-5734e630d974 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:31.338508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:31.345699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3241c-290b-46c3-9a36-5734e630d974 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:31.379487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:31.380266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:31.380542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:31.380810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] PATH_INFO: `/v3/services/placement` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:31.381440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:31.382815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 15:17:31.395029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 15:17:31.396194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application with Lock( Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self._enter() Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application return self.creator() Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application created_value = creator( Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: ERROR keystone.server.flask.application Jul 06 15:17:31.397228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 648/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 15:17:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 15:17:31.402267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:31.474936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:31.496547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01745c6-06a3-4968-b83b-11faf67345d2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:31.528835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:31.529478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:31.529756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:31.530055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:31.530748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:17:31.531129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:31.532481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71834432-7f8b-46cd-be22-73d1bf753e56 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:31.538036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 657/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 15:17:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:17:31.543719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:17:31.637596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f8396-ea1f-460c-b5ce-69d11d1595de None admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:17:31.670191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:17:31.670768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:17:31.671044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:17:31.671313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:17:31.672042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:17:31.673379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a69b9a-e0b1-4d6a-885b-00cd2953fb08 None admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:17:31.690621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 649/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 15:17:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:17:41.534487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=30 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:17:41.686394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:34.267029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115a02-4576-4257-b63f-551746f5e38d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:34.267661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115a02-4576-4257-b63f-551746f5e38d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:34.267661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115a02-4576-4257-b63f-551746f5e38d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:34.274821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a37a1-0a7c-418f-84ba-6f5abb7a004f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:34.275254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a37a1-0a7c-418f-84ba-6f5abb7a004f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:34.275339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a37a1-0a7c-418f-84ba-6f5abb7a004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:34.278721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 658/1307] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:34.364585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9c3a37a1-0a7c-418f-84ba-6f5abb7a004f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:34.365818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c3a37a1-0a7c-418f-84ba-6f5abb7a004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:34.602659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 650/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:34.636485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:34.637159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:34.637447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:34.638857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 659/1309] 10.222.0.25 () {54 vars in 964 bytes} [Wed Jul 6 15:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:34.645701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c90-0bf3-4b1c-a71a-18261f8d21df None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:34.645974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c90-0bf3-4b1c-a71a-18261f8d21df None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:34.646257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0233c90-0bf3-4b1c-a71a-18261f8d21df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:34.753892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b0233c90-0bf3-4b1c-a71a-18261f8d21df None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:34.755650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0233c90-0bf3-4b1c-a71a-18261f8d21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:34.780642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:34.841810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 651/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Jul 6 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:18:34.850965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:34.852655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:34.970299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec4bc5-c3b2-4502-ae74-095dc9c09636 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:35.049753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:35.050437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:35.050639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:35.050909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:35.052711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:35.108652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:35.168287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:35.169728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee2d3-0b1c-40eb-86ab-665b70702549 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:35.190130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 660/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:37.510030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:37.510595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:37.510595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:37.512329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 652/1312] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:37.517800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c6a9-5a2c-4560-bc4e-25dcf57bb6e9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:37.518270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c6a9-5a2c-4560-bc4e-25dcf57bb6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:37.518361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c6a9-5a2c-4560-bc4e-25dcf57bb6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:37.588925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ebe9c6a9-5a2c-4560-bc4e-25dcf57bb6e9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:37.590150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ebe9c6a9-5a2c-4560-bc4e-25dcf57bb6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:37.698388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 661/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:37.727700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:37.729475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:37.852598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231727-bbcc-421c-9ddb-52bf016c0527 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:37.930825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:37.933530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:37.934247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:37.934975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:37.935257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:37.937475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:38.055196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:38.059190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca162-e9ac-467b-9095-9af1e4d3fa73 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:38.079466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 653/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:40.369289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:40.369855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:40.369855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:40.371362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 662/1315] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:40.376866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c22d5-efe4-4dbb-be30-a7ff8ca959d8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:40.377286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c22d5-efe4-4dbb-be30-a7ff8ca959d8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:40.377422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c22d5-efe4-4dbb-be30-a7ff8ca959d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:40.441032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-de4c22d5-efe4-4dbb-be30-a7ff8ca959d8 None None] MFA Rules not processed for user `9ab00cd064eb43448fa87e10489a3018`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:40.442254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-de4c22d5-efe4-4dbb-be30-a7ff8ca959d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:40.494346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:40.538835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 654/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:40.578377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:40.579892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:40.589416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:40.680500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea4a3-f0cc-4b81-ae84-391d236f434d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:40.752009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:40.752644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:40.752921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:40.753189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:40.754832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:40.815896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:40.862116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:40.863545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dd90b-b320-4376-ba61-2d72376dc371 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:40.881584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 663/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:43.438376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:43.438928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:43.439316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:43.440879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 655/1318] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:43.446151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf062-83f5-4cdd-b97b-3d0c25a3cd48 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:43.446571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf062-83f5-4cdd-b97b-3d0c25a3cd48 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:43.446703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf062-83f5-4cdd-b97b-3d0c25a3cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:43.509692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7aeaf062-83f5-4cdd-b97b-3d0c25a3cd48 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:43.510949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7aeaf062-83f5-4cdd-b97b-3d0c25a3cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:43.604772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 664/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:43.643531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:43.645093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:43.755653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0481-a26e-4fc6-9f97-e4aac7a8f002 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:43.827744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:43.828384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:43.828663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:43.828937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:43.830604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:43.837825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:43.938794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:43.940166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7e38-586d-49ac-ad44-33119640ae17 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:43.958124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 656/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:46.631498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:46.632037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:46.632156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:46.633660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 665/1321] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:46.639392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee443-c48b-4abb-a872-09d0f4767b5a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:46.639860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee443-c48b-4abb-a872-09d0f4767b5a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:46.639956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee443-c48b-4abb-a872-09d0f4767b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:46.704007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aedee443-c48b-4abb-a872-09d0f4767b5a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:46.705833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aedee443-c48b-4abb-a872-09d0f4767b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:46.769892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:46.812219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 657/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:18:46.849514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:46.851102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:46.871128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:46.961208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2925c3-baf4-4c01-a149-7307d5363eba None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:47.033036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:47.033680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:47.033988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:47.034261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:47.035884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:47.108997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:47.149141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:47.150519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacce72-3ea3-48e0-9a4b-949669147a21 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:47.168772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 666/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:49.234647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:49.235160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:49.235160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:49.237034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 658/1324] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:49.242123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde95e3-1da2-4896-9e15-99a5359f3715 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:49.242518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde95e3-1da2-4896-9e15-99a5359f3715 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:49.242796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde95e3-1da2-4896-9e15-99a5359f3715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:49.312800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-efde95e3-1da2-4896-9e15-99a5359f3715 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:49.314043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-efde95e3-1da2-4896-9e15-99a5359f3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:49.408876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 667/1325] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:18:49.444789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:49.446415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:49.550027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea559d-50ea-4298-b7ba-7620bbc54611 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:49.624509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:49.625165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:49.625444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:49.625715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:49.628081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:49.645436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:49.737282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:49.738744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf0e4-c3dd-4995-ad85-c5899f087f4b service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:49.757455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 659/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:51.858505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:51.859038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:51.859038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:51.860463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 668/1327] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:51.865659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7a60-d0dc-4382-b323-7f97285a8a3c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:51.866119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7a60-d0dc-4382-b323-7f97285a8a3c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:51.866260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7a60-d0dc-4382-b323-7f97285a8a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:51.934159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4afa7a60-d0dc-4382-b323-7f97285a8a3c None None] MFA Rules not processed for user `9ab00cd064eb43448fa87e10489a3018`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:51.935368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4afa7a60-d0dc-4382-b323-7f97285a8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:52.003105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:52.038779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 660/1328] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:52.076973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:52.078573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:52.108855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:52.185725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1c59e-cd10-4c14-9063-33577828bb89 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:52.260130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:52.260778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:52.261062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:52.261340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:52.263261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:52.342755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:52.395483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:52.396945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50be770-78bb-4630-ac1c-de79c7c65b73 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:52.421409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 669/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:18:54.672679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:54.673223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:54.673223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:54.674619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 661/1330] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:54.679733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ea4-6f46-4236-8760-1ed435882f2e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:54.680164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ea4-6f46-4236-8760-1ed435882f2e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:54.680279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ea4-6f46-4236-8760-1ed435882f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:54.742620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5bf18ea4-6f46-4236-8760-1ed435882f2e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:54.743806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5bf18ea4-6f46-4236-8760-1ed435882f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:54.838610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 670/1331] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:54.874111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:54.875667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:54.979407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db48fc-97d7-40ec-a723-5af70650f82f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:55.050793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:55.051435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:55.051712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:55.051978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:55.053597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:55.083687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:55.163009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:55.164432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9bf40-b3ff-4ef8-a649-621e5167974a service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:55.182639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 662/1332] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:18:57.225185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:57.225718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:57.225718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:57.227152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 671/1333] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:18:57.232448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d5b2-dc90-4577-b67f-b48ba6c712dd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:57.232849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d5b2-dc90-4577-b67f-b48ba6c712dd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:57.232998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234d5b2-dc90-4577-b67f-b48ba6c712dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:57.297577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5234d5b2-dc90-4577-b67f-b48ba6c712dd None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:18:57.299431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5234d5b2-dc90-4577-b67f-b48ba6c712dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:57.372820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:57.395071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 663/1334] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:18:57.435013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:18:57.436518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:57.475651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:57.537485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862660-1d4c-4485-bde9-b253a40a3c86 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:18:57.608445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:18:57.609088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:18:57.609368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:18:57.609641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:18:57.611888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:18:57.691784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:18:57.723292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:18:57.724730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3093b-851a-4eb6-bb07-2e067cd008ee service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:18:57.742822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 672/1335] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:00.068460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:00.069035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:00.069035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:00.070747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 664/1336] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:00.076009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a09f7-f8a9-4158-ae3d-d6263c9b28c9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:00.076414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a09f7-f8a9-4158-ae3d-d6263c9b28c9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:00.076566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a09f7-f8a9-4158-ae3d-d6263c9b28c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:00.141027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2c6a09f7-f8a9-4158-ae3d-d6263c9b28c9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:00.142340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2c6a09f7-f8a9-4158-ae3d-d6263c9b28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:00.238819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 673/1337] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:00.275063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:00.276554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:00.378575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cc69-3cf2-496c-a476-2c3731d4320f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:00.450153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:00.450787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:00.451063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:00.451332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:00.452944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:00.487052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:00.559383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:00.560818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d215e-ba30-4c91-84e3-7d2ff9c0465e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:00.579573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 665/1338] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:04.472922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:04.473474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:04.473474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:04.474913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 674/1339] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:04.480343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f569-b5a0-4e9f-bbe1-743820cbb76a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:04.480773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f569-b5a0-4e9f-bbe1-743820cbb76a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:04.480902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f569-b5a0-4e9f-bbe1-743820cbb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:04.552481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6371f569-b5a0-4e9f-bbe1-743820cbb76a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:04.553690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6371f569-b5a0-4e9f-bbe1-743820cbb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:04.647018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:04.660675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 666/1340] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:04.700592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:04.702223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:04.750092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:04.806514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e2398-3685-4617-9c92-894c0bebcc86 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:04.880643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:04.881353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:04.881640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:04.881941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:04.971534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:04.973243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be860-6d83-4696-aa76-f8bb320606b0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:04.982928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 675/1341] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:07.652265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409033-fd71-4382-ae36-b3118968545d None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:07.652798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409033-fd71-4382-ae36-b3118968545d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:07.652798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409033-fd71-4382-ae36-b3118968545d None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:07.654124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 667/1342] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:07.659811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a909-6516-459a-a06c-a9636543b785 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:07.660345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a909-6516-459a-a06c-a9636543b785 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:07.660502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0a909-6516-459a-a06c-a9636543b785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:07.666042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:07.692081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-35c0a909-6516-459a-a06c-a9636543b785 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:07.693311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-35c0a909-6516-459a-a06c-a9636543b785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:07.774701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 676/1343] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:07.812470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba409033-fd71-4382-ae36-b3118968545d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:07.814284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ba409033-fd71-4382-ae36-b3118968545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:07.909834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba409033-fd71-4382-ae36-b3118968545d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:07.913351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:07.914032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:07.914320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:07.914599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:07.925809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:07.927273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f168aa-a465-4675-ac2b-c2a30c526cdf service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:07.936818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 668/1344] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:11.876593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36993c-0e20-435f-a346-7a3bdd1ea868 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:11.877082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36993c-0e20-435f-a346-7a3bdd1ea868 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:11.877202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36993c-0e20-435f-a346-7a3bdd1ea868 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:11.878553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 677/1345] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:11.883760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844a4-e1c1-48ca-b04d-d62f96dbb597 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:11.884207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844a4-e1c1-48ca-b04d-d62f96dbb597 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:11.884542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844a4-e1c1-48ca-b04d-d62f96dbb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:11.903305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7ff844a4-e1c1-48ca-b04d-d62f96dbb597 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:11.904600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7ff844a4-e1c1-48ca-b04d-d62f96dbb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:11.912521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 669/1346] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:11.950626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36993c-0e20-435f-a346-7a3bdd1ea868 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:11.961195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36993c-0e20-435f-a346-7a3bdd1ea868 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:11.964757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:11.965468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:11.965754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:11.966056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:11.975010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:11.976419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee07d1-1b5f-4108-ae0c-efb4d5efafb5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:11.986218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 678/1347] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:16.900803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c881a-3251-493d-865b-e02b3297a064 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:16.901262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c881a-3251-493d-865b-e02b3297a064 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:16.901453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c881a-3251-493d-865b-e02b3297a064 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:16.904694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 670/1348] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:19:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:16.910569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d140c7-1d02-4110-9205-05c987d16873 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:16.911003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d140c7-1d02-4110-9205-05c987d16873 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:16.911180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d140c7-1d02-4110-9205-05c987d16873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:17.007011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9d140c7-1d02-4110-9205-05c987d16873 None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:17.008028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9d140c7-1d02-4110-9205-05c987d16873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:17.106803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 679/1349] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:19:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:21.460826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a18a-7cb1-4578-9b32-41980d10c810 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:21.461385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a18a-7cb1-4578-9b32-41980d10c810 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:21.461385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2a18a-7cb1-4578-9b32-41980d10c810 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:21.462760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 671/1350] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:21.468012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3116f-2060-4e43-aebb-1eec14aa56d9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:21.469384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3116f-2060-4e43-aebb-1eec14aa56d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:21.469927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3116f-2060-4e43-aebb-1eec14aa56d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:21.490522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-78d3116f-2060-4e43-aebb-1eec14aa56d9 None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:21.491914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-78d3116f-2060-4e43-aebb-1eec14aa56d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:21.503600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 680/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:21.902354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=49 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:22.879498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096ce3-0045-4ab6-a0e2-8e45dd638030 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:22.880156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096ce3-0045-4ab6-a0e2-8e45dd638030 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:22.880156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096ce3-0045-4ab6-a0e2-8e45dd638030 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:22.881651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 672/1352] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:22.887189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f2b0-e56b-4b4c-805d-63e44d4a3f02 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:22.887661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f2b0-e56b-4b4c-805d-63e44d4a3f02 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:22.887754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f2b0-e56b-4b4c-805d-63e44d4a3f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:22.895561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:22.906823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-47c7f2b0-e56b-4b4c-805d-63e44d4a3f02 None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:22.908008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-47c7f2b0-e56b-4b4c-805d-63e44d4a3f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:22.916434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 681/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:26.515774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c8bb-022f-4043-bab3-2749547078ee None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:26.516682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c8bb-022f-4043-bab3-2749547078ee None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:26.517155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366c8bb-022f-4043-bab3-2749547078ee None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:26.522440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 673/1354] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:26.526131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0a70-1fb2-406a-b693-f4e6f3de5c75 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:26.526581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0a70-1fb2-406a-b693-f4e6f3de5c75 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:26.526676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0a70-1fb2-406a-b693-f4e6f3de5c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:26.547740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d70b0a70-1fb2-406a-b693-f4e6f3de5c75 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:26.548992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d70b0a70-1fb2-406a-b693-f4e6f3de5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:26.557635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 682/1355] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:26.617126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed9013-d92a-48da-9493-5950b454cf68 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:26.617839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed9013-d92a-48da-9493-5950b454cf68 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:26.618536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed9013-d92a-48da-9493-5950b454cf68 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:26.620872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 674/1356] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 15:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:26.629796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2d99d-8d53-40a0-818d-0c0bea9db664 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:26.630363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2d99d-8d53-40a0-818d-0c0bea9db664 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:26.631655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2d99d-8d53-40a0-818d-0c0bea9db664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:26.685699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f1c2d99d-8d53-40a0-818d-0c0bea9db664 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:26.686906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1c2d99d-8d53-40a0-818d-0c0bea9db664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:26.769940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 683/1357] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:26.777735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed9013-d92a-48da-9493-5950b454cf68 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:26.794827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed9013-d92a-48da-9493-5950b454cf68 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:26.801300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:26.802020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:26.802311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:26.802589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:26.811422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:26.813074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4407e1-585b-481a-a049-e1b4096b4151 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:26.823136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 675/1358] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:29.065857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08795-94ce-41e9-b490-d856543dc546 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:29.066465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08795-94ce-41e9-b490-d856543dc546 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:29.066465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08795-94ce-41e9-b490-d856543dc546 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:29.067952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 684/1359] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:29.072899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06963-3947-4c92-9332-45180aa8001a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:29.073692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06963-3947-4c92-9332-45180aa8001a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:29.073998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06963-3947-4c92-9332-45180aa8001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:29.091875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-44c06963-3947-4c92-9332-45180aa8001a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:29.093065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-44c06963-3947-4c92-9332-45180aa8001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:29.101387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 676/1360] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:29.146371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f08795-94ce-41e9-b490-d856543dc546 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:29.161415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f08795-94ce-41e9-b490-d856543dc546 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:29.166820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:29.167450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:29.167732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:29.168006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:29.176513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:29.178136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995dc45-f47c-4da6-8716-e67828aefc1f service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:29.187863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 685/1361] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:31.522465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0282bd-b26b-4e5e-9a87-8e4e5e838508 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:31.522933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0282bd-b26b-4e5e-9a87-8e4e5e838508 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:31.523050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0282bd-b26b-4e5e-9a87-8e4e5e838508 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:31.524410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 677/1362] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:31.529659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a2c6-c5d6-4325-ad6f-dccc187f041c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:31.530141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a2c6-c5d6-4325-ad6f-dccc187f041c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:31.530236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a2c6-c5d6-4325-ad6f-dccc187f041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:31.549197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-42e4a2c6-c5d6-4325-ad6f-dccc187f041c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:31.550419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-42e4a2c6-c5d6-4325-ad6f-dccc187f041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:31.560074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 686/1363] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:31.613368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746c47-8400-41c3-af4e-9d97b149a5ab None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:31.613651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746c47-8400-41c3-af4e-9d97b149a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:31.613980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746c47-8400-41c3-af4e-9d97b149a5ab None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:31.615336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 678/1364] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:31.620764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fe34-985b-48c8-91e1-94cfbe9def1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:31.621050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fe34-985b-48c8-91e1-94cfbe9def1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:31.621323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fe34-985b-48c8-91e1-94cfbe9def1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:31.640705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-09f6fe34-985b-48c8-91e1-94cfbe9def1b None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:31.641885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-09f6fe34-985b-48c8-91e1-94cfbe9def1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:31.650996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 687/1365] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:31.659066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746c47-8400-41c3-af4e-9d97b149a5ab None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:31.673944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746c47-8400-41c3-af4e-9d97b149a5ab None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:31.679286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:31.679925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:31.680202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:31.680471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:31.689148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:31.690758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec223-003d-44ea-bc4d-bd2fa6490d12 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:31.700292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 679/1366] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:33.781682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0faa4-e5d9-46a5-87c3-cce64573ff62 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:33.782595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0faa4-e5d9-46a5-87c3-cce64573ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:33.783040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0faa4-e5d9-46a5-87c3-cce64573ff62 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:33.784576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 688/1367] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:33.789725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d499-e33b-447a-a037-342106e9fc7f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:33.790192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d499-e33b-447a-a037-342106e9fc7f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:33.790316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d499-e33b-447a-a037-342106e9fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:33.809809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-17f7d499-e33b-447a-a037-342106e9fc7f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:33.811322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-17f7d499-e33b-447a-a037-342106e9fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:33.821288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 680/1368] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:33.865623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0faa4-e5d9-46a5-87c3-cce64573ff62 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:33.882626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0faa4-e5d9-46a5-87c3-cce64573ff62 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:33.889553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:33.891007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:33.891407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:33.891774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:33.902483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:33.904246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f036c-2125-4356-ab1f-b2e406371978 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:33.917056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 689/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:34.623334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7548f-11bf-451f-bf28-628339be35fa None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:34.623825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7548f-11bf-451f-bf28-628339be35fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:34.624210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7548f-11bf-451f-bf28-628339be35fa None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:34.626449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 681/1370] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:34.632019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7f0a-604f-4811-836c-7d6e2fe5cd26 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:34.632313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7f0a-604f-4811-836c-7d6e2fe5cd26 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:34.632597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7f0a-604f-4811-836c-7d6e2fe5cd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:34.651208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1b0a7f0a-604f-4811-836c-7d6e2fe5cd26 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:34.652413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b0a7f0a-604f-4811-836c-7d6e2fe5cd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:34.660719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 690/1371] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:34.971613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09e2d-3d53-43ae-a47a-14e2b1c15cfd None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:34.972028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09e2d-3d53-43ae-a47a-14e2b1c15cfd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:34.972167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09e2d-3d53-43ae-a47a-14e2b1c15cfd None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:34.973710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 682/1372] 10.222.0.25 () {54 vars in 963 bytes} [Wed Jul 6 15:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:34.978866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2807-acf6-4ec6-9c9d-5c2fd48dac3f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:34.979272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2807-acf6-4ec6-9c9d-5c2fd48dac3f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:34.979444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2807-acf6-4ec6-9c9d-5c2fd48dac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:35.033891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5bec2807-acf6-4ec6-9c9d-5c2fd48dac3f None None] MFA Rules not processed for user `bb8ca62c1d2e458d9831415740222bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:35.035297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5bec2807-acf6-4ec6-9c9d-5c2fd48dac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:35.069919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:35.105954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 691/1373] 10.222.0.25 () {58 vars in 1060 bytes} [Wed Jul 6 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:35.113619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09e2d-3d53-43ae-a47a-14e2b1c15cfd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:35.125246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09e2d-3d53-43ae-a47a-14e2b1c15cfd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:35.128892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:35.129789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:35.130198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:35.130563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:35.140834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:35.142545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964aa658-c90d-4c13-8ab6-2685662a9a3c service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:35.152354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 683/1374] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:35.981423 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823501e9-4098-42e4-a982-320a03f69b6e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:35.981976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823501e9-4098-42e4-a982-320a03f69b6e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:35.982246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823501e9-4098-42e4-a982-320a03f69b6e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:35.983377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 692/1375] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:35.988603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4318bd-eea6-406e-99d5-9707ba6b00e6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:35.989126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4318bd-eea6-406e-99d5-9707ba6b00e6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:35.989126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4318bd-eea6-406e-99d5-9707ba6b00e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:36.009600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0f4318bd-eea6-406e-99d5-9707ba6b00e6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:36.011155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0f4318bd-eea6-406e-99d5-9707ba6b00e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:36.020927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 684/1376] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:36.065682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823501e9-4098-42e4-a982-320a03f69b6e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:36.080287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823501e9-4098-42e4-a982-320a03f69b6e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:36.085650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:36.086318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:36.086600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:36.086876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:36.095695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:36.097278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2049b28-6b19-4beb-ab6b-793526ce8fab service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:36.106579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 693/1377] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:38.174672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa0e0-6f3f-434a-b695-01939f1fe1f4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:38.175469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa0e0-6f3f-434a-b695-01939f1fe1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:38.175934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa0e0-6f3f-434a-b695-01939f1fe1f4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:38.178472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 685/1378] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:38.188305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317a3f-5644-4aaf-8877-7fe9ad575f84 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:38.189226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317a3f-5644-4aaf-8877-7fe9ad575f84 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:38.189724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317a3f-5644-4aaf-8877-7fe9ad575f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:38.212544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a3317a3f-5644-4aaf-8877-7fe9ad575f84 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:38.213795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a3317a3f-5644-4aaf-8877-7fe9ad575f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:38.221684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 694/1379] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:38.266615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fa0e0-6f3f-434a-b695-01939f1fe1f4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:38.281274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fa0e0-6f3f-434a-b695-01939f1fe1f4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:38.290487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:38.291136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:38.291421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:38.291697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:38.301335 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:38.303229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690555-9e28-41ce-a953-db2cef536438 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:38.315175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 686/1380] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:40.377577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8790e5-738f-48ed-8c1b-bb0ac18532d8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:40.378450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8790e5-738f-48ed-8c1b-bb0ac18532d8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:40.378920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8790e5-738f-48ed-8c1b-bb0ac18532d8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:40.380538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 695/1381] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:40.386129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89beff-1c4b-4479-b69a-ea93b2e3bfdb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:40.386544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89beff-1c4b-4479-b69a-ea93b2e3bfdb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:40.386680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89beff-1c4b-4479-b69a-ea93b2e3bfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:40.405238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8e89beff-1c4b-4479-b69a-ea93b2e3bfdb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:40.406930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e89beff-1c4b-4479-b69a-ea93b2e3bfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:40.414966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 687/1382] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:40.456699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8790e5-738f-48ed-8c1b-bb0ac18532d8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:40.472648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8790e5-738f-48ed-8c1b-bb0ac18532d8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:40.479326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:40.480102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:40.480977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:40.481356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:40.490568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:40.492411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1b300-918b-4b12-9b86-ed44e3241587 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:40.504866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 696/1383] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:42.552032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf4f4-9bc1-4fef-a574-95286ff4901f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:42.552032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf4f4-9bc1-4fef-a574-95286ff4901f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:42.552032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf4f4-9bc1-4fef-a574-95286ff4901f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:42.554778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 688/1384] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:42.559649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b31e-1f39-4b9f-b6a0-50cc8d5ee67d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:42.560393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b31e-1f39-4b9f-b6a0-50cc8d5ee67d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:42.560393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622b31e-1f39-4b9f-b6a0-50cc8d5ee67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:42.578191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2622b31e-1f39-4b9f-b6a0-50cc8d5ee67d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:42.581338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2622b31e-1f39-4b9f-b6a0-50cc8d5ee67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:42.602390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 697/1385] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:42.650903 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf4f4-9bc1-4fef-a574-95286ff4901f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:42.665837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf4f4-9bc1-4fef-a574-95286ff4901f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:42.671803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:42.672446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:42.672739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:42.673001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:42.681396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:42.683099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428a737-d004-4aab-bbfe-8c0c50daabfd service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:42.693041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 689/1386] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:44.756443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6680db-0ad2-4e5b-a478-f357b887e264 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:44.757018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6680db-0ad2-4e5b-a478-f357b887e264 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:44.757131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6680db-0ad2-4e5b-a478-f357b887e264 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:44.759031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 698/1387] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:44.765640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fedd8a-7ba3-4736-ac19-255fa204189e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:44.766179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fedd8a-7ba3-4736-ac19-255fa204189e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:44.766287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fedd8a-7ba3-4736-ac19-255fa204189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:44.784300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c8fedd8a-7ba3-4736-ac19-255fa204189e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:44.785502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c8fedd8a-7ba3-4736-ac19-255fa204189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:44.793397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 690/1388] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:44.845590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6680db-0ad2-4e5b-a478-f357b887e264 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:44.860485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6680db-0ad2-4e5b-a478-f357b887e264 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:44.865958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:44.866600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:44.866883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:44.867167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:44.875617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:44.877191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef32ede-6a5e-4d76-9715-dffab0fe23e3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:44.887109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 699/1389] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:46.938859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371a6e-be64-40c1-bc71-fcedc24d8bbd None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:46.939402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371a6e-be64-40c1-bc71-fcedc24d8bbd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:46.939402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371a6e-be64-40c1-bc71-fcedc24d8bbd None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:46.940783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 691/1390] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:46.946038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8480c-8842-4a94-9213-396e7e814619 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:46.946501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8480c-8842-4a94-9213-396e7e814619 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:46.946601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8480c-8842-4a94-9213-396e7e814619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:46.964132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-88e8480c-8842-4a94-9213-396e7e814619 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:46.965353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88e8480c-8842-4a94-9213-396e7e814619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:46.974468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 700/1391] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:47.028152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1371a6e-be64-40c1-bc71-fcedc24d8bbd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:47.047233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1371a6e-be64-40c1-bc71-fcedc24d8bbd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:47.052779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:47.053426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:47.053710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:47.054017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:47.063074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:47.064730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0486a7-4c30-4468-a158-ab72e81ce375 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:47.074502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 692/1392] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:19:49.137563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d31e8-55fb-4909-a195-15e28e487e36 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:49.138278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d31e8-55fb-4909-a195-15e28e487e36 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:49.138278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d31e8-55fb-4909-a195-15e28e487e36 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:49.139505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 701/1393] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:49.145338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6e10-cc58-4cd8-9260-f8f5f27af593 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:49.145775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6e10-cc58-4cd8-9260-f8f5f27af593 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:49.145880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6e10-cc58-4cd8-9260-f8f5f27af593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:49.163548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c4bf6e10-cc58-4cd8-9260-f8f5f27af593 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:49.164742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c4bf6e10-cc58-4cd8-9260-f8f5f27af593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:49.172678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 693/1394] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:49.216561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d31e8-55fb-4909-a195-15e28e487e36 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:49.230933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d31e8-55fb-4909-a195-15e28e487e36 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:49.236359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:49.236989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:49.237275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:49.237554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:49.245780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:49.247504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3d4c-c7ea-4c06-9f3e-3010142f1216 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:49.257509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 702/1395] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:50.318975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f47f1-e559-423d-902f-4d238f7b5ffa None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:50.319443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f47f1-e559-423d-902f-4d238f7b5ffa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:50.319547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f47f1-e559-423d-902f-4d238f7b5ffa None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:50.320901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 694/1396] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:50.326151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567783-9519-4375-9ebb-b427a7f04193 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:50.326604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567783-9519-4375-9ebb-b427a7f04193 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:50.326712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567783-9519-4375-9ebb-b427a7f04193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:50.345295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e2567783-9519-4375-9ebb-b427a7f04193 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:50.346521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e2567783-9519-4375-9ebb-b427a7f04193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:50.359053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 703/1397] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:50.414967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb622c1-8cae-47b0-b93c-3bdd92bd74b4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:50.415277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb622c1-8cae-47b0-b93c-3bdd92bd74b4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:50.415630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb622c1-8cae-47b0-b93c-3bdd92bd74b4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:50.417067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 695/1398] 10.222.0.25 () {54 vars in 962 bytes} [Wed Jul 6 15:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:50.422485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc19e-c8db-4876-88fa-9fef5a165cea None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:50.422777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc19e-c8db-4876-88fa-9fef5a165cea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:50.423058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc19e-c8db-4876-88fa-9fef5a165cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:50.471326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-131cc19e-c8db-4876-88fa-9fef5a165cea None None] MFA Rules not processed for user `9c21819f774b4052bced3ef15f6d83d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:50.472519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-131cc19e-c8db-4876-88fa-9fef5a165cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:50.531400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 704/1399] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Jul 6 15:19:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:50.538889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb622c1-8cae-47b0-b93c-3bdd92bd74b4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:50.550252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb622c1-8cae-47b0-b93c-3bdd92bd74b4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:50.553693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:50.554361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:50.554645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:50.554921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:50.563867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:50.565319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6aa95-4eda-4e93-b6f7-8e438e9282ca service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:50.574901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 696/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:19:51.278550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140a3b-3bb0-46be-9d69-9215d3073eac None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.278838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140a3b-3bb0-46be-9d69-9215d3073eac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.279115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9140a3b-3bb0-46be-9d69-9215d3073eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.318278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367fe2-b7de-4188-85d5-0775e2fef5a9 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.318563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367fe2-b7de-4188-85d5-0775e2fef5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.318866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367fe2-b7de-4188-85d5-0775e2fef5a9 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.320213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 697/1401] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:19:51.325085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.325401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.325676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.329354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:51.332487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b9140a3b-3bb0-46be-9d69-9215d3073eac None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:51.334163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b9140a3b-3bb0-46be-9d69-9215d3073eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:51.343927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:51.345086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:51.352797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 698/1402] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:51.396692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:51.407493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 705/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:19:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:19:51.409214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe51fa2-aaa0-41ab-b02c-c7621323672b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:51.414589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:51.415229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.415510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.415778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.425972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:51.426763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8613c6-c5d7-4d84-82d6-18b86a8ddc5f service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:51.436403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 699/1404] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:19:51.448404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495be654-a24b-4198-91a6-3bf9f605ce75 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.448735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495be654-a24b-4198-91a6-3bf9f605ce75 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.449100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495be654-a24b-4198-91a6-3bf9f605ce75 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.450733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 706/1405] 10.222.0.25 () {54 vars in 942 bytes} [Wed Jul 6 15:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:19:51.458203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead03f3-25ed-4161-9f81-f40b8516429a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.458514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead03f3-25ed-4161-9f81-f40b8516429a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.458793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead03f3-25ed-4161-9f81-f40b8516429a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.511547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dead03f3-25ed-4161-9f81-f40b8516429a None None] MFA Rules not processed for user `530cf69a596d42eeb576903bb39816cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:19:51.512803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dead03f3-25ed-4161-9f81-f40b8516429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:19:51.557871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:19:51.592942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 700/1406] 10.222.0.25 () {58 vars in 1039 bytes} [Wed Jul 6 15:19:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:19:51.602570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495be654-a24b-4198-91a6-3bf9f605ce75 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:19:51.616769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495be654-a24b-4198-91a6-3bf9f605ce75 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:19:51.621920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:19:51.622603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:19:51.622889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:19:51.623167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:19:51.633070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:19:51.634757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eda728-a9d3-4d71-ac18-ff233b27e5f3 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:19:51.644545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 707/1407] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:20:01.589806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=13 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:20:01.640944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=32 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:20:13.686822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6bae-b7ae-4e8f-8412-98b3583a2452 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:13.687340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6bae-b7ae-4e8f-8412-98b3583a2452 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:13.687340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6bae-b7ae-4e8f-8412-98b3583a2452 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:13.688647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 701/1408] 10.222.0.25 () {54 vars in 918 bytes} [Wed Jul 6 15:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:13.693591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be7b5-0bc1-4106-a57f-6286946fc8fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:13.694028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be7b5-0bc1-4106-a57f-6286946fc8fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:13.694161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be7b5-0bc1-4106-a57f-6286946fc8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:13.712613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-075be7b5-0bc1-4106-a57f-6286946fc8fc None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:13.713803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-075be7b5-0bc1-4106-a57f-6286946fc8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:13.722394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 708/1409] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Jul 6 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:13.739215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ba41-cfb6-4834-a92c-6d0678e9359b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:13.739498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ba41-cfb6-4834-a92c-6d0678e9359b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:13.739772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49ba41-cfb6-4834-a92c-6d0678e9359b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:13.741283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 702/1410] 10.222.0.25 () {54 vars in 918 bytes} [Wed Jul 6 15:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:13.746181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceebf1-402b-4480-9f17-4935ff9b2e8f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:13.746467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceebf1-402b-4480-9f17-4935ff9b2e8f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:13.746738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceebf1-402b-4480-9f17-4935ff9b2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:13.764974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b3ceebf1-402b-4480-9f17-4935ff9b2e8f None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:13.766181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3ceebf1-402b-4480-9f17-4935ff9b2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:13.775066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Jul 6 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:16.228360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617f5-f3a7-4cc4-9804-5bcc5efe30e5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:16.228863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617f5-f3a7-4cc4-9804-5bcc5efe30e5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:16.228962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617f5-f3a7-4cc4-9804-5bcc5efe30e5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:16.230302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 703/1412] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:16.236139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b41d6-fd7b-4815-a5da-c08cd353c817 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:16.236572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b41d6-fd7b-4815-a5da-c08cd353c817 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:16.236684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b41d6-fd7b-4815-a5da-c08cd353c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:16.254407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8a4b41d6-fd7b-4815-a5da-c08cd353c817 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:16.255089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a4b41d6-fd7b-4815-a5da-c08cd353c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:16.263512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 710/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:16.307701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e617f5-f3a7-4cc4-9804-5bcc5efe30e5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:16.323896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e617f5-f3a7-4cc4-9804-5bcc5efe30e5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:16.329311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:16.329982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:16.330267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:16.330543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:16.338749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:16.340324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7637fd-2eeb-486c-bc4d-577b93e21cf9 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:16.350251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 704/1414] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:17.239013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9a6f-2a09-471b-a581-1e281e7c3a25 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:17.239580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9a6f-2a09-471b-a581-1e281e7c3a25 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:17.239580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9a6f-2a09-471b-a581-1e281e7c3a25 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:17.240934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 711/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:17.245699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596745-1073-4911-a591-79d37fe1e2c8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:17.246143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596745-1073-4911-a591-79d37fe1e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:17.246337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c596745-1073-4911-a591-79d37fe1e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:17.264731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5c596745-1073-4911-a591-79d37fe1e2c8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:17.265937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5c596745-1073-4911-a591-79d37fe1e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:17.273819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 705/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:17.422613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9a6f-2a09-471b-a581-1e281e7c3a25 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:17.436779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9a6f-2a09-471b-a581-1e281e7c3a25 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:17.442192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:17.442820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:17.443102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:17.443375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:17.451844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:17.453411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b316-d88d-4b2b-b07e-d5c2223d5211 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:17.462672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 712/1417] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:18.332495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac589-9e70-4a3d-bb8b-43649726f090 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:18.332934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac589-9e70-4a3d-bb8b-43649726f090 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:18.333040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac589-9e70-4a3d-bb8b-43649726f090 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:18.334445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 706/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:18.339247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3a31-bcdc-4889-bc9c-2d4d6868a37a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:18.339658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3a31-bcdc-4889-bc9c-2d4d6868a37a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:18.339797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a3a31-bcdc-4889-bc9c-2d4d6868a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:18.357800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-235a3a31-bcdc-4889-bc9c-2d4d6868a37a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:18.359021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-235a3a31-bcdc-4889-bc9c-2d4d6868a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:18.366814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 713/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:20:18.518959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac589-9e70-4a3d-bb8b-43649726f090 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:18.533025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac589-9e70-4a3d-bb8b-43649726f090 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:18.538355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:18.538986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:18.539270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:18.539546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:18.547550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:18.549113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2680-5130-4fc3-bbb7-ae5938ee2833 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:18.561201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 707/1420] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:19.414068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233340-4fff-47bc-8c71-e8112ef1542e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:19.414583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233340-4fff-47bc-8c71-e8112ef1542e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:19.414732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82233340-4fff-47bc-8c71-e8112ef1542e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:19.416017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 714/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:19.421041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fc7-b2fa-41e9-9848-5a94f91a14b1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:19.421470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fc7-b2fa-41e9-9848-5a94f91a14b1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:19.421607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b716fc7-b2fa-41e9-9848-5a94f91a14b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:19.439307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9b716fc7-b2fa-41e9-9848-5a94f91a14b1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:19.440507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9b716fc7-b2fa-41e9-9848-5a94f91a14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:19.448226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 708/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:19.598021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82233340-4fff-47bc-8c71-e8112ef1542e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:19.612810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82233340-4fff-47bc-8c71-e8112ef1542e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:19.618196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:19.618826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:19.619110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:19.619382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:19.627953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:19.629520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876a82a-b0aa-4a49-8a5c-7566fbbd5417 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:19.639000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 715/1423] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:20.491725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc8a0-3ee6-4bcc-ae20-bf2046d85278 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:20.492322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc8a0-3ee6-4bcc-ae20-bf2046d85278 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:20.492322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc8a0-3ee6-4bcc-ae20-bf2046d85278 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:20.493680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 709/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:20.499120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea661-17bf-4d73-8687-40ff82ddc757 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:20.499561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea661-17bf-4d73-8687-40ff82ddc757 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:20.499664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea661-17bf-4d73-8687-40ff82ddc757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:20.518265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-376ea661-17bf-4d73-8687-40ff82ddc757 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:20.519456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-376ea661-17bf-4d73-8687-40ff82ddc757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:20.527195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 716/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:20.677561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc8a0-3ee6-4bcc-ae20-bf2046d85278 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:20.691655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc8a0-3ee6-4bcc-ae20-bf2046d85278 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:20.696910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:20.697538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:20.697818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:20.698119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:20.706044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:20.707605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8d31f-1f13-4ced-8380-2d614a92f9c1 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:20.717404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 710/1426] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:21.513675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043322a0-c73f-4e37-b186-f13b424b6f25 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:21.514275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043322a0-c73f-4e37-b186-f13b424b6f25 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:21.514275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043322a0-c73f-4e37-b186-f13b424b6f25 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:21.515643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 717/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:21.520369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7fa-5830-4caa-8f74-6d65d879f158 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:21.520786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7fa-5830-4caa-8f74-6d65d879f158 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:21.520926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d7fa-5830-4caa-8f74-6d65d879f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:21.539026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6fb9d7fa-5830-4caa-8f74-6d65d879f158 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:21.540206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6fb9d7fa-5830-4caa-8f74-6d65d879f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:21.548857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 711/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:21.697999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043322a0-c73f-4e37-b186-f13b424b6f25 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:21.713468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043322a0-c73f-4e37-b186-f13b424b6f25 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:21.719722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:21.720352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:21.720635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:21.720914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:21.729069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:21.730693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb0494-f9a2-40c7-947c-c8a48d4c5abc service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:21.740026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 718/1429] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:22.531533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547df0a-7dfc-49c3-9f32-d56adc2772af None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:22.532156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547df0a-7dfc-49c3-9f32-d56adc2772af None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:22.532156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547df0a-7dfc-49c3-9f32-d56adc2772af None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:22.533443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 712/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:22.538176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cacc5d-a758-462c-8bc6-06468fd8f803 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:22.538653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cacc5d-a758-462c-8bc6-06468fd8f803 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:22.538764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cacc5d-a758-462c-8bc6-06468fd8f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:22.556329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-49cacc5d-a758-462c-8bc6-06468fd8f803 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:22.557501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-49cacc5d-a758-462c-8bc6-06468fd8f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:22.565179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 719/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:22.717586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547df0a-7dfc-49c3-9f32-d56adc2772af None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:22.736239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547df0a-7dfc-49c3-9f32-d56adc2772af None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:22.741522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:22.742200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:22.742484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:22.742759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:22.751705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:22.753584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80fdb-2748-4325-915a-f05332944130 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:22.764031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 713/1432] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:23.561242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fccd1-255a-483e-a81b-c9a2439bc958 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:23.561796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fccd1-255a-483e-a81b-c9a2439bc958 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:23.561796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fccd1-255a-483e-a81b-c9a2439bc958 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:23.563154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 720/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:23.567880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101197-6a51-4656-b9a2-4dd842681063 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:23.568317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101197-6a51-4656-b9a2-4dd842681063 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:23.568420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71101197-6a51-4656-b9a2-4dd842681063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:23.587337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-71101197-6a51-4656-b9a2-4dd842681063 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:23.588517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-71101197-6a51-4656-b9a2-4dd842681063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:23.596244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 714/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:23.743813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fccd1-255a-483e-a81b-c9a2439bc958 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:23.758604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fccd1-255a-483e-a81b-c9a2439bc958 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:23.764892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:23.765523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:23.765807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:23.766114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:23.775584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:23.777169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bdc9b-006a-4fdf-bb7b-d51f1ea20447 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:23.786786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 721/1435] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:24.577176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead46bb-fdd3-420d-96e4-35ac08270331 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:24.577747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead46bb-fdd3-420d-96e4-35ac08270331 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:24.577747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead46bb-fdd3-420d-96e4-35ac08270331 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:24.579096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 715/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:20:24.583848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833956-35b9-4c4a-9d49-c9c283e47bed None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:24.584277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833956-35b9-4c4a-9d49-c9c283e47bed None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:24.584391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01833956-35b9-4c4a-9d49-c9c283e47bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:24.602117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01833956-35b9-4c4a-9d49-c9c283e47bed None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:24.603303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01833956-35b9-4c4a-9d49-c9c283e47bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:24.611010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 722/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:24.759446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead46bb-fdd3-420d-96e4-35ac08270331 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:24.776407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead46bb-fdd3-420d-96e4-35ac08270331 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:24.781845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:24.782508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:24.782790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:24.783063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:24.791231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:24.792833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ba3e3-72bb-4928-beb7-b0b08ddb1f11 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:24.802596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 716/1438] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:26.730439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6ecb-17bf-4c98-aa0e-c07ff0587ac6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:26.731012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6ecb-17bf-4c98-aa0e-c07ff0587ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:26.731012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6ecb-17bf-4c98-aa0e-c07ff0587ac6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:26.732412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 723/1439] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:26.737659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8a7a-174b-45bb-bc99-be11de732d90 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:26.738094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8a7a-174b-45bb-bc99-be11de732d90 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:26.738242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8a7a-174b-45bb-bc99-be11de732d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:26.756136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-eeac8a7a-174b-45bb-bc99-be11de732d90 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:26.757306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-eeac8a7a-174b-45bb-bc99-be11de732d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:26.765853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 717/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:26.803462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6ecb-17bf-4c98-aa0e-c07ff0587ac6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:26.814535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6ecb-17bf-4c98-aa0e-c07ff0587ac6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:26.818048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:26.818680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:26.818967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:26.819243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:26.828660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:26.830119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717aeca-e8d5-4ff4-95ec-0fca50f582a7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:26.839444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 724/1441] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:29.013356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241449-ff19-413e-95db-44ebbd83aa02 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:29.014029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241449-ff19-413e-95db-44ebbd83aa02 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:29.014029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241449-ff19-413e-95db-44ebbd83aa02 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:29.015297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 718/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:29.021221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc49d-eee6-4c5e-8d45-0e6bccfaf626 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:29.021665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc49d-eee6-4c5e-8d45-0e6bccfaf626 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:29.021762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc49d-eee6-4c5e-8d45-0e6bccfaf626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:29.041012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ca5bc49d-eee6-4c5e-8d45-0e6bccfaf626 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:29.042315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca5bc49d-eee6-4c5e-8d45-0e6bccfaf626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:29.054373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 725/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:29.091941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241449-ff19-413e-95db-44ebbd83aa02 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:29.102559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241449-ff19-413e-95db-44ebbd83aa02 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:29.106030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:29.106669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:29.106956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:29.107230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:29.116035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:29.117530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde368-9ad5-4735-bc38-aad2d9bcc6ff service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:29.127421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 719/1444] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:31.430162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd84b7-86bc-405e-8c4b-ad3efd26c82e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:31.430688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd84b7-86bc-405e-8c4b-ad3efd26c82e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:31.430780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd84b7-86bc-405e-8c4b-ad3efd26c82e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:31.432296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 726/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:31.437633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd96-b85c-4f60-8f34-3a47a0846e78 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:31.438041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd96-b85c-4f60-8f34-3a47a0846e78 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:31.438150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd96-b85c-4f60-8f34-3a47a0846e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:31.456212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-673bbd96-b85c-4f60-8f34-3a47a0846e78 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:31.457387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-673bbd96-b85c-4f60-8f34-3a47a0846e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:31.465073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 720/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:31.503039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd84b7-86bc-405e-8c4b-ad3efd26c82e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:31.514652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd84b7-86bc-405e-8c4b-ad3efd26c82e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:31.518071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:31.518696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:31.518976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:31.519247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:31.527870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:31.529863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d94e3-935c-4efd-ab2e-53ed51109ed4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:31.539009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 727/1447] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:33.655233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ef8d-ec3e-4c41-9a11-035aaf97289b None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:33.655801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ef8d-ec3e-4c41-9a11-035aaf97289b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:33.655801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ef8d-ec3e-4c41-9a11-035aaf97289b None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:33.657142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 721/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:33.662357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbd43-b32b-4e32-986d-215a5e7778ad None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:33.662799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbd43-b32b-4e32-986d-215a5e7778ad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:33.662895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbd43-b32b-4e32-986d-215a5e7778ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:33.680169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-62edbd43-b32b-4e32-986d-215a5e7778ad None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:33.681376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-62edbd43-b32b-4e32-986d-215a5e7778ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:33.689081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 728/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:33.728170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6ef8d-ec3e-4c41-9a11-035aaf97289b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:33.739322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6ef8d-ec3e-4c41-9a11-035aaf97289b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:33.743389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:33.744063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:33.744347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:33.744622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:33.754688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:33.756153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ba2b-8f82-489b-8797-8f8c30f0341e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:33.766359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 722/1450] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:35.927379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f9c8-1eb7-4bd3-90de-38b10d70663a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:35.927911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f9c8-1eb7-4bd3-90de-38b10d70663a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:35.928041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5f9c8-1eb7-4bd3-90de-38b10d70663a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:35.929346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 729/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:35.934609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4126-7718-4730-8965-d7767cb4e6de None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:35.935544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4126-7718-4730-8965-d7767cb4e6de None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:35.935740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4126-7718-4730-8965-d7767cb4e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:35.954849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a79f4126-7718-4730-8965-d7767cb4e6de None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:35.956061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a79f4126-7718-4730-8965-d7767cb4e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:35.964148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 723/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:36.001827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5f9c8-1eb7-4bd3-90de-38b10d70663a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:36.012773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5f9c8-1eb7-4bd3-90de-38b10d70663a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:36.016191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:36.016847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:36.017127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:36.017397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:36.026484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:36.027909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dec016-6ef0-4fc4-b662-85ab5dca1182 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:36.037110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 730/1453] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:38.087651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15de54-6c3f-4160-a311-74ac585bd6e8 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:38.088203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15de54-6c3f-4160-a311-74ac585bd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:38.088203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15de54-6c3f-4160-a311-74ac585bd6e8 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:38.089559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 724/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:38.095845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668de3-a7b5-400a-85b2-f607c01791d5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:38.096371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668de3-a7b5-400a-85b2-f607c01791d5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:38.096542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668de3-a7b5-400a-85b2-f607c01791d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:38.115436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb668de3-a7b5-400a-85b2-f607c01791d5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:38.116663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb668de3-a7b5-400a-85b2-f607c01791d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:38.125245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 731/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:20:38.163434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15de54-6c3f-4160-a311-74ac585bd6e8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:38.174899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15de54-6c3f-4160-a311-74ac585bd6e8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:38.178402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:38.179038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:38.179318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:38.179591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:38.190373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:38.191832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1e6a-7b76-4978-9e05-c772b657f75c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:38.201288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 725/1456] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:40.259152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e97e-36fa-4eec-b9ad-caa231a59a70 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:40.259902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e97e-36fa-4eec-b9ad-caa231a59a70 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:40.259995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e97e-36fa-4eec-b9ad-caa231a59a70 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:40.261324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:40.267215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f08f87-c092-4e67-a10d-49f5a2010ed7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:40.267649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f08f87-c092-4e67-a10d-49f5a2010ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:40.267801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f08f87-c092-4e67-a10d-49f5a2010ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:40.285203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-35f08f87-c092-4e67-a10d-49f5a2010ed7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:40.286495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-35f08f87-c092-4e67-a10d-49f5a2010ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:40.294323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:40.331800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077e97e-36fa-4eec-b9ad-caa231a59a70 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:40.342378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077e97e-36fa-4eec-b9ad-caa231a59a70 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:40.345935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:40.346581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:40.346869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:40.347149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:40.356098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:40.357541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdaf3e-1727-4e3a-92f8-26400e2ff1c7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:40.366820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 733/1459] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:42.410105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645e1f-5bef-426f-9d33-5bdea5cb1683 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:42.410644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645e1f-5bef-426f-9d33-5bdea5cb1683 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:42.410749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645e1f-5bef-426f-9d33-5bdea5cb1683 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:42.412091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 727/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:42.417147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2048b-41d4-448d-9d5b-2ca6c86fbd14 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:42.417570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2048b-41d4-448d-9d5b-2ca6c86fbd14 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:42.417690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2048b-41d4-448d-9d5b-2ca6c86fbd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:42.424314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=79 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:20:42.436958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1db2048b-41d4-448d-9d5b-2ca6c86fbd14 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:42.438114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1db2048b-41d4-448d-9d5b-2ca6c86fbd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:42.445851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 734/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:42.483019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645e1f-5bef-426f-9d33-5bdea5cb1683 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:42.488277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=73 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:20:42.494583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645e1f-5bef-426f-9d33-5bdea5cb1683 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:42.498073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:42.498699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:42.498975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:42.499247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:42.507959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:42.509624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f1c03-191e-4a58-a7e4-ff6c42f5cd71 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:42.519168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 728/1462] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:20:44.540957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2207d65-ab5a-46d4-bcf0-e6a23c2ab46b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:44.541528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2207d65-ab5a-46d4-bcf0-e6a23c2ab46b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:44.541528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2207d65-ab5a-46d4-bcf0-e6a23c2ab46b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:44.542943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:44.548699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6afb-6829-4af2-aa18-21431881bf2a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:44.549120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6afb-6829-4af2-aa18-21431881bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:44.549232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6afb-6829-4af2-aa18-21431881bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:44.566740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fa9f6afb-6829-4af2-aa18-21431881bf2a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:44.567936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fa9f6afb-6829-4af2-aa18-21431881bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:44.575679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:44.611704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2207d65-ab5a-46d4-bcf0-e6a23c2ab46b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:44.622273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2207d65-ab5a-46d4-bcf0-e6a23c2ab46b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:44.625697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:44.626504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:44.626785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:44.627058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:44.636114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:44.637524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940598-c8f6-443b-a8de-dd47eeb7c012 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:44.646827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 736/1465] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:46.662661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6af23-dfba-4829-92f0-3f6f0347a5b5 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:46.663227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6af23-dfba-4829-92f0-3f6f0347a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:46.663227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6af23-dfba-4829-92f0-3f6f0347a5b5 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:46.664594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:46.670304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302468-86d4-45ce-b34c-7e0e77060451 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:46.670747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302468-86d4-45ce-b34c-7e0e77060451 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:46.670855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302468-86d4-45ce-b34c-7e0e77060451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:46.688659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-97302468-86d4-45ce-b34c-7e0e77060451 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:46.689836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-97302468-86d4-45ce-b34c-7e0e77060451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:46.697547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:46.748379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9aef-e200-46ee-aa3a-a1da50998e8c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:46.748658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9aef-e200-46ee-aa3a-a1da50998e8c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:46.748933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9aef-e200-46ee-aa3a-a1da50998e8c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:46.750334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 731/1468] 10.222.0.25 () {54 vars in 964 bytes} [Wed Jul 6 15:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:20:46.756136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57e18-a1da-4995-8b9e-5db33a922cda None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:46.756435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57e18-a1da-4995-8b9e-5db33a922cda None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:46.756706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57e18-a1da-4995-8b9e-5db33a922cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:46.795593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c8f57e18-a1da-4995-8b9e-5db33a922cda None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:20:46.796788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c8f57e18-a1da-4995-8b9e-5db33a922cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:20:46.803200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 738/1469] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Jul 6 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:20:46.812154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9aef-e200-46ee-aa3a-a1da50998e8c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:20:46.822460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9aef-e200-46ee-aa3a-a1da50998e8c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:20:46.825849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:20:46.826502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:20:46.826779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:20:46.827055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:20:46.835638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:20:46.837053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef108-a8ff-49bc-9330-24f2a19f43f2 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:20:46.848292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 732/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:20:56.792493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=20 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:20:56.842614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=14 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:21:06.787094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f934a7-34ec-4055-b574-3cb414ae629c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:06.787614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f934a7-34ec-4055-b574-3cb414ae629c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:06.787614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f934a7-34ec-4055-b574-3cb414ae629c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:06.788941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 739/1471] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:06.795076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3543a-2b5c-40b5-8186-3695c338c741 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:06.795470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3543a-2b5c-40b5-8186-3695c338c741 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:06.795619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3543a-2b5c-40b5-8186-3695c338c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:06.813581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3ff3543a-2b5c-40b5-8186-3695c338c741 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:06.814796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3ff3543a-2b5c-40b5-8186-3695c338c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:06.822399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:06.904104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748459-45b9-45bc-8231-471aba4942fe None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:06.904388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748459-45b9-45bc-8231-471aba4942fe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:06.904661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd748459-45b9-45bc-8231-471aba4942fe None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:06.906060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 740/1473] 10.222.0.25 () {54 vars in 962 bytes} [Wed Jul 6 15:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:06.910733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e680a3-5b5d-478d-aeab-07625f00f194 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:06.911025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e680a3-5b5d-478d-aeab-07625f00f194 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:06.911302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e680a3-5b5d-478d-aeab-07625f00f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:06.929214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-06e680a3-5b5d-478d-aeab-07625f00f194 None None] MFA Rules not processed for user `9c21819f774b4052bced3ef15f6d83d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:06.930415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-06e680a3-5b5d-478d-aeab-07625f00f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:06.937171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Jul 6 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:06.944283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd748459-45b9-45bc-8231-471aba4942fe None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:06.954695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd748459-45b9-45bc-8231-471aba4942fe None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:06.958159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:06.958776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:06.959056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:06.959328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:06.968178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:06.969602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cec74f-5588-43a6-9fa1-052bebf3d694 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:06.979244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 741/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:09.088260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79867-d249-4565-96b4-8a387ca4dd66 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:09.088837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79867-d249-4565-96b4-8a387ca4dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:09.088837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79867-d249-4565-96b4-8a387ca4dd66 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:09.090282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 735/1476] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:09.095515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d931f-71de-4a52-a560-d0a440f52887 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:09.095939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d931f-71de-4a52-a560-d0a440f52887 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:09.096077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d931f-71de-4a52-a560-d0a440f52887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:09.113974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-241d931f-71de-4a52-a560-d0a440f52887 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:09.115162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-241d931f-71de-4a52-a560-d0a440f52887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:09.123507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:21:09.146790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79867-d249-4565-96b4-8a387ca4dd66 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:09.159393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79867-d249-4565-96b4-8a387ca4dd66 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:09.163783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:09.164422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:09.164710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:09.164994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:09.165720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:09.168051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:21:09.168051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:21:09.168051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:21:09.169168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a615a-a5b6-4c1d-87a8-d6ec57183518 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:09.188701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 736/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 15:21:09 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:21:11.261753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064786-ac6d-41a4-87a7-b203e87bca87 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:11.262360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064786-ac6d-41a4-87a7-b203e87bca87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:11.262360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2064786-ac6d-41a4-87a7-b203e87bca87 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:11.263698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 743/1479] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:11.268734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25784-ad0a-4217-ab60-639f44bba98a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:11.269134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25784-ad0a-4217-ab60-639f44bba98a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:11.269276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25784-ad0a-4217-ab60-639f44bba98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:11.287559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e7e25784-ad0a-4217-ab60-639f44bba98a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:11.288739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e7e25784-ad0a-4217-ab60-639f44bba98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:11.296496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:11.340702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064786-ac6d-41a4-87a7-b203e87bca87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:11.354710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2064786-ac6d-41a4-87a7-b203e87bca87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:11.360072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:11.360701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:11.360979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:11.361247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:11.369176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:11.370782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a58b9-0eaf-4f23-8080-d5695bdc4a66 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:11.380003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 744/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:13.579241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef5bb-36b3-4e1b-a5e4-354eaa59278c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:13.579772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef5bb-36b3-4e1b-a5e4-354eaa59278c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:13.579772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef5bb-36b3-4e1b-a5e4-354eaa59278c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:13.581080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 738/1482] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:13.586304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c105-aec1-45e9-bae5-171a77e849f3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:13.586724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c105-aec1-45e9-bae5-171a77e849f3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:13.586853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c105-aec1-45e9-bae5-171a77e849f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:13.604210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-da90c105-aec1-45e9-bae5-171a77e849f3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:13.605932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da90c105-aec1-45e9-bae5-171a77e849f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:13.613505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:13.649590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef5bb-36b3-4e1b-a5e4-354eaa59278c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:13.660186 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef5bb-36b3-4e1b-a5e4-354eaa59278c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:13.663657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:13.664283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:13.664562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:13.664836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:13.674111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:13.675527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240babc-b3de-4544-aacf-7fa7ba7bcf06 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:13.685394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 739/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:15.736639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e768b-32d6-4046-8379-fdbad7307e02 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:15.737204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e768b-32d6-4046-8379-fdbad7307e02 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:15.737204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e768b-32d6-4046-8379-fdbad7307e02 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:15.738629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 746/1485] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:15.743795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ef1f4-b04a-485b-b010-dc8bbbe4b060 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:15.744223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ef1f4-b04a-485b-b010-dc8bbbe4b060 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:15.744343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ef1f4-b04a-485b-b010-dc8bbbe4b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:15.762444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1b7ef1f4-b04a-485b-b010-dc8bbbe4b060 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:15.763652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1b7ef1f4-b04a-485b-b010-dc8bbbe4b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:15.771608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:15.809036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e768b-32d6-4046-8379-fdbad7307e02 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:15.819751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e768b-32d6-4046-8379-fdbad7307e02 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:15.823248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:15.824382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:15.824682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:15.824937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:15.833956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:15.835396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8274a-719e-4930-a7a0-ba661dfbaf99 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:15.845169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 747/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:18.019467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b205-748d-479a-ac64-4a4815198124 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:18.020055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b205-748d-479a-ac64-4a4815198124 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:18.020055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b205-748d-479a-ac64-4a4815198124 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:18.021380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 741/1488] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:18.026419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a1d1-3c7d-455b-849f-d74fbfeeb882 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:18.027436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a1d1-3c7d-455b-849f-d74fbfeeb882 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:18.027594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a1d1-3c7d-455b-849f-d74fbfeeb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:18.044883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dfa0a1d1-3c7d-455b-849f-d74fbfeeb882 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:18.046120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dfa0a1d1-3c7d-455b-849f-d74fbfeeb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:18.053989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:18.093806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b205-748d-479a-ac64-4a4815198124 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:18.104529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b205-748d-479a-ac64-4a4815198124 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:18.108027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:18.108657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:18.108939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:18.109213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:18.117975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:18.119393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6b7b-3763-4337-95c7-af193f8876ab service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:18.128661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 742/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:20.320343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea436-7b42-401a-9180-3e0cc502c73a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:20.320775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea436-7b42-401a-9180-3e0cc502c73a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:20.320900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea436-7b42-401a-9180-3e0cc502c73a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:20.322323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 749/1491] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 15:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:21:20.328092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e60b3-11b6-4a5c-aee0-8478d837ae22 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:20.328531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e60b3-11b6-4a5c-aee0-8478d837ae22 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:20.328652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e60b3-11b6-4a5c-aee0-8478d837ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:20.346772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5d8e60b3-11b6-4a5c-aee0-8478d837ae22 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:21:20.347970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5d8e60b3-11b6-4a5c-aee0-8478d837ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:21:20.355965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:21:20.394469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea436-7b42-401a-9180-3e0cc502c73a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:21:20.405831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea436-7b42-401a-9180-3e0cc502c73a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:21:20.409379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:21:20.410042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:21:20.410322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:21:20.410615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:21:20.419387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:21:20.420798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caee52-862c-46da-b5ee-34204d8aaa4c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:21:20.429925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 750/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:21:30.341578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=33 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:21:30.425916 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=33 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:45.946285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:45.946881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:45.946881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:45.966124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:22:45.967310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:45.975093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:22:45.983136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:45.983658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:45.983766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.001972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:22:46.003158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:46.012084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:22:46.016435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.025814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a1f8-b80f-4d1d-8cfd-4cdd3236b4ba None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.030184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.030828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.031104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.031372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.032078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:22:46.032375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.033371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.033371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:22:46.033371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:22:46.034289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.045786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:22:46.053518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.063484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b31d1-e817-4c71-ac8c-843b783e5363 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.068056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.068703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.068985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.069259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.070641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.072421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.072421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:22:46.072421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:22:46.073619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.110476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 752/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:22:46 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:22:46.114639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.124421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b5fb-5a12-4cc6-a240-aaf6b1cbd2a0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.182192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.183124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.183429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.183707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.184395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.185419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.185419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:22:46.185419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:22:46.186657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.205510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 746/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:22:46 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:22:46.209597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.220510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524a679-6f10-43f5-b9f9-7a7fb1891fc2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.224999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.225646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.226529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.226807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.227530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.228543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.228543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:22:46.228543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:22:46.229420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.241975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:22:46.245619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.255397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d96db-2d1f-494f-a8e0-0192ba21f474 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.260292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.260937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.261219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.261491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.262243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.263254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.263254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:22:46.263254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:22:46.264123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6ce7-9209-427e-ae2a-8690f94ddd48 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.277746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:22:46.281851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.292189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb59b-c5fc-4575-9984-160d564b164a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.296824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.297689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.298001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.298278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] PATH_INFO: `/v3/projects/2bf4c15ebeec4202bff91a23a4969a64/users/bbfd71d415534f6fb9cd62bf1c0352e1/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.313167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf4c15ebeec4202bff91a23a4969a64, user_id=bbfd71d415534f6fb9cd62bf1c0352e1, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.314232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.314232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:22:46.314232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:22:46.316158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beadd2-e14a-4cb9-925e-b664990d47c9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.328804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 754/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:22:46 2022] PUT /identity/v3/projects/2bf4c15ebeec4202bff91a23a4969a64/users/bbfd71d415534f6fb9cd62bf1c0352e1/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:22:46.341513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d820-2db8-4630-b7ff-18ab725966be None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.341797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d820-2db8-4630-b7ff-18ab725966be None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.342105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3d820-2db8-4630-b7ff-18ab725966be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.367860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-95c3d820-2db8-4630-b7ff-18ab725966be None None] MFA Rules not processed for user `bbfd71d415534f6fb9cd62bf1c0352e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:22:46.369066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-95c3d820-2db8-4630-b7ff-18ab725966be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:46.431571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:22:46.444439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd6a-c730-44e4-9f4d-06abdee7a5c0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.445266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd6a-c730-44e4-9f4d-06abdee7a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.445546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beadd6a-c730-44e4-9f4d-06abdee7a5c0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.446962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 755/1503] 10.222.0.25 () {54 vars in 963 bytes} [Wed Jul 6 15:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:22:46.451916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafbc2-83ae-4c59-9d98-c806681a3691 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.452205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafbc2-83ae-4c59-9d98-c806681a3691 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.452484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdafbc2-83ae-4c59-9d98-c806681a3691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.471406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1bdafbc2-83ae-4c59-9d98-c806681a3691 None None] MFA Rules not processed for user `bb8ca62c1d2e458d9831415740222bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:22:46.472582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1bdafbc2-83ae-4c59-9d98-c806681a3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:46.514258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:46.522159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Wed Jul 6 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:22:46.530493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beadd6a-c730-44e4-9f4d-06abdee7a5c0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.540998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beadd6a-c730-44e4-9f4d-06abdee7a5c0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.544553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.545179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.545462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.545738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.554160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.555616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.564599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 756/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:22:46.606352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32ee1-4ba6-4457-a336-7e6bd27eba24 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.606641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32ee1-4ba6-4457-a336-7e6bd27eba24 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.606917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32ee1-4ba6-4457-a336-7e6bd27eba24 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.608180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 750/1506] 10.222.0.25 () {52 vars in 829 bytes} [Wed Jul 6 15:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:22:46.611656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.672528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc8e71-e08f-41a5-8160-7680dec00c42 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.677046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.677920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.678216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.678492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] PATH_INFO: `/v3/users/bbfd71d415534f6fb9cd62bf1c0352e1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.679690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfd71d415534f6fb9cd62bf1c0352e1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.680715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:46.680715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:22:46.680715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:22:46.681941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.744782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfd71d415534f6fb9cd62bf1c0352e1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:46.745450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfd71d415534f6fb9cd62bf1c0352e1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:46.746094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfd71d415534f6fb9cd62bf1c0352e1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:46.759458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfd71d415534f6fb9cd62bf1c0352e1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:46.768821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfd71d415534f6fb9cd62bf1c0352e1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:46.784524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:46.793425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:22:46 2022] DELETE /identity/v3/users/bbfd71d415534f6fb9cd62bf1c0352e1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:22:46.797840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.798220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.798499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.816079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:22:46.817253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:46.874047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:22:46.884119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:46.885524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:46.942385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32df020-4399-409f-bf90-76715942e2b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:46.946557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:46.947197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:46.947479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:46.947752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:46.956532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:46.957993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c159dc0-c750-4d06-96d2-1a350360c23d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:46.967279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 758/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:22:47.326338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:22:47.327813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:22:47.339735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cc02-fd79-4c17-a08d-275b79ddeb8b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:22:47.345089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:22:47.346039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:22:47.348245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:22:47.348245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] PATH_INFO: `/v3/projects/2bf4c15ebeec4202bff91a23a4969a64` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:22:47.349185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf4c15ebeec4202bff91a23a4969a64)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:22:47.350234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:22:47.350234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:22:47.350234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:22:47.351925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:22:47.419643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf4c15ebeec4202bff91a23a4969a64', 'request_id': 'req-fe44f87a-3f31-4c29-a297-03f4e5dabb16'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:47.425633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf4c15ebeec4202bff91a23a4969a64', 'request_id': 'req-fe44f87a-3f31-4c29-a297-03f4e5dabb16'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:47.435764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf4c15ebeec4202bff91a23a4969a64', 'request_id': 'req-fe44f87a-3f31-4c29-a297-03f4e5dabb16'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:47.453788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] The token cache is being invalidate because project 2bf4c15ebeec4202bff91a23a4969a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:22:47.454124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:47.454857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fe44f87a-3f31-4c29-a297-03f4e5dabb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:22:47.456405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:22:47 2022] DELETE /identity/v3/projects/2bf4c15ebeec4202bff91a23a4969a64 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:22:56.963149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:22:57.450814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:33.745181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:33.745791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:33.745791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:33.747213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:33.754052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac274ac-cd8c-4453-8c8e-7869206fb323 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:33.754468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac274ac-cd8c-4453-8c8e-7869206fb323 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:33.754617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac274ac-cd8c-4453-8c8e-7869206fb323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:33.775327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7ac274ac-cd8c-4453-8c8e-7869206fb323 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:33.776540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7ac274ac-cd8c-4453-8c8e-7869206fb323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:33.834244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:33.988258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:33.990058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:34.061944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fad9f-31d9-4485-9f35-2a2d76108449 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:34.067731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:34.068363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:34.068642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:34.068913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:34.077344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:34.078939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bc72f-0827-4104-a511-b23b3086dd4b service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:34.088696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 760/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:34.913855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b5e0-0ce6-475a-a6c9-19be287f7689 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:34.914411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b5e0-0ce6-475a-a6c9-19be287f7689 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:34.914532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7b5e0-0ce6-475a-a6c9-19be287f7689 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:34.915804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:34.920812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0059a-1a50-4167-95d2-d9806e9cad7d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:34.921281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0059a-1a50-4167-95d2-d9806e9cad7d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:34.921393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0059a-1a50-4167-95d2-d9806e9cad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:34.939500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9cc0059a-1a50-4167-95d2-d9806e9cad7d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:34.940675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9cc0059a-1a50-4167-95d2-d9806e9cad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:34.948466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:24:35.099444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7b5e0-0ce6-475a-a6c9-19be287f7689 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:35.113992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7b5e0-0ce6-475a-a6c9-19be287f7689 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:35.119271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:35.119972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:35.120251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:35.120522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:35.128729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:35.130339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162dd5b-a865-467b-8ff3-7bd7aeb2d78d service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:35.139493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 755/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:35.681072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b41d6-202a-4e60-81ed-3ace13b56c2b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:35.681286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b41d6-202a-4e60-81ed-3ace13b56c2b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:35.681539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b41d6-202a-4e60-81ed-3ace13b56c2b None None] PATH_INFO: `/v3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:35.682890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 762/1517] 10.222.0.36 () {54 vars in 925 bytes} [Wed Jul 6 15:24:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:24:35.695985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae167fff-cb41-42b2-8c2b-ef8fdabf0f56 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:35.696273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae167fff-cb41-42b2-8c2b-ef8fdabf0f56 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:35.696547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae167fff-cb41-42b2-8c2b-ef8fdabf0f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:35.714701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ae167fff-cb41-42b2-8c2b-ef8fdabf0f56 None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:35.715876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ae167fff-cb41-42b2-8c2b-ef8fdabf0f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:35.775996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 756/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jul 6 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:39.677486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dfe-7c81-4b66-89b9-eefa8def07f8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:39.678298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dfe-7c81-4b66-89b9-eefa8def07f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:39.678298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4dfe-7c81-4b66-89b9-eefa8def07f8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:39.679322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 763/1519] 10.222.0.25 () {54 vars in 960 bytes} [Wed Jul 6 15:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:39.684445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8af4-81b6-4128-8c87-afddce07bd3e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:39.684865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8af4-81b6-4128-8c87-afddce07bd3e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:39.685019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8af4-81b6-4128-8c87-afddce07bd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:39.703585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e7ca8af4-81b6-4128-8c87-afddce07bd3e None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:39.704784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e7ca8af4-81b6-4128-8c87-afddce07bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:39.713877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 757/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Jul 6 15:24:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:24:39.721200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4dfe-7c81-4b66-89b9-eefa8def07f8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:39.735337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4dfe-7c81-4b66-89b9-eefa8def07f8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:39.740775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:39.741412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:39.741691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:39.741994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:39.750455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:39.752038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb8a0-59a6-4f48-83dc-498cf7c04ffd service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:39.762527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 764/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:46.367865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc4d1-b33b-4ce4-9531-77dd0fc27ad4 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:46.368346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc4d1-b33b-4ce4-9531-77dd0fc27ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:46.368455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc4d1-b33b-4ce4-9531-77dd0fc27ad4 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:46.369845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:46.374523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4954-40e8-4d76-aa09-c1c1fc2edaa6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:46.374989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4954-40e8-4d76-aa09-c1c1fc2edaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:46.375101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4954-40e8-4d76-aa09-c1c1fc2edaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:46.392720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8f9a4954-40e8-4d76-aa09-c1c1fc2edaa6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:46.393921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f9a4954-40e8-4d76-aa09-c1c1fc2edaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:46.401976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:46.555247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc4d1-b33b-4ce4-9531-77dd0fc27ad4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:46.569327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc4d1-b33b-4ce4-9531-77dd0fc27ad4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:46.574585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:46.575218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:46.575498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:46.575773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:46.584343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:46.585930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e847b7-254a-4e01-8c04-1eccaf1e8c81 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:46.595185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 759/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:47.403438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7767-aac9-42b6-93df-8a48cbd682ce None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:47.403978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7767-aac9-42b6-93df-8a48cbd682ce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:47.403978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7767-aac9-42b6-93df-8a48cbd682ce None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:47.405345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:47.410658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4df9-de79-44cc-91b9-f82d29f6982a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:47.411111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4df9-de79-44cc-91b9-f82d29f6982a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:47.411217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4df9-de79-44cc-91b9-f82d29f6982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:47.428763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f27b4df9-de79-44cc-91b9-f82d29f6982a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:47.429979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f27b4df9-de79-44cc-91b9-f82d29f6982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:47.437655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:24:47.588514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d7767-aac9-42b6-93df-8a48cbd682ce None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:47.602513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d7767-aac9-42b6-93df-8a48cbd682ce None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:47.607801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:47.608431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:47.608707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:47.608975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:47.617301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:47.618909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6c635-0d55-4612-9f38-96893ebd2bf3 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:47.628465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 767/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:51.426454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:51.426968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:51.427063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:51.428360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:51.433457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128a37-c2f1-42f2-a62e-e22ab5c693b9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:51.433860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128a37-c2f1-42f2-a62e-e22ab5c693b9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:51.434054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128a37-c2f1-42f2-a62e-e22ab5c693b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:51.451569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-92128a37-c2f1-42f2-a62e-e22ab5c693b9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:51.452752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-92128a37-c2f1-42f2-a62e-e22ab5c693b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:51.460493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:51.532172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:51.533854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:51.590482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494f924-ba76-41dd-95a6-0bef4ddf3884 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:51.593822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:51.594487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:51.594765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:51.595037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:51.606146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:51.607567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacfa45-6594-4818-8254-aec15f0e7711 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:51.612452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:51.618212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 762/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:53.630301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c900-25a6-486d-8510-256f3cfc3a4b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:53.630839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c900-25a6-486d-8510-256f3cfc3a4b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:53.630839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c900-25a6-486d-8510-256f3cfc3a4b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:53.632162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:24:53.637325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc78-ae75-450a-9069-2fb9555e5540 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:53.637739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc78-ae75-450a-9069-2fb9555e5540 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:53.637879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc78-ae75-450a-9069-2fb9555e5540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:53.655610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b491dc78-ae75-450a-9069-2fb9555e5540 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:53.656796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b491dc78-ae75-450a-9069-2fb9555e5540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:53.665340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:53.700606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c900-25a6-486d-8510-256f3cfc3a4b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:53.711083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c900-25a6-486d-8510-256f3cfc3a4b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:53.714516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:53.715133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:53.715411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:53.715681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:53.724855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:53.726424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69108-a9b9-4d6d-845b-d97e076181da service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:53.735543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 770/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:57.318003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:57.318470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:57.318572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:57.319911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:57.325004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2a58-c94f-43d9-a323-fd7e553cbd4c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:57.325410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2a58-c94f-43d9-a323-fd7e553cbd4c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:57.325587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2a58-c94f-43d9-a323-fd7e553cbd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:57.331880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=62 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:24:57.344313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9cc2a58-c94f-43d9-a323-fd7e553cbd4c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:57.345498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9cc2a58-c94f-43d9-a323-fd7e553cbd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:57.353783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:24:57.653283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:24:57.654954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:57.711758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238281-4f04-4841-b06b-0fbfe5caf095 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:24:57.715217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:24:57.715849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:57.716134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:57.716390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:57.725587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:24:57.727031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fe2d5-8d9d-497e-8b36-a013bca63568 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:24:57.736362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 765/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:24:59.748365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:59.748920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:59.749033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:59.750367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 15:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:24:59.756200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1683b1-b954-4fa2-a6fa-facf2cf73c45 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:24:59.756611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1683b1-b954-4fa2-a6fa-facf2cf73c45 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:24:59.756757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1683b1-b954-4fa2-a6fa-facf2cf73c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:24:59.774861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6e1683b1-b954-4fa2-a6fa-facf2cf73c45 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:24:59.776040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6e1683b1-b954-4fa2-a6fa-facf2cf73c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:24:59.783683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 15:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:25:00.078444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:25:00.080098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:25:00.092798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0328361-f8b4-47b5-9006-2a448ca62555 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:25:00.096291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:25:00.096923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:25:00.097198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:25:00.097470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:25:00.106200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:25:00.107620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e57ad-1918-43b6-8894-446df73e70a1 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:25:00.117328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 773/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:25:09.769892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=32 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:25:10.112719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=8 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:30.894329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa755d7-f510-4228-8b6d-003155af94a2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:30.894991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa755d7-f510-4228-8b6d-003155af94a2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:30.894991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa755d7-f510-4228-8b6d-003155af94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:30.920644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1aa755d7-f510-4228-8b6d-003155af94a2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:30.921827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1aa755d7-f510-4228-8b6d-003155af94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:30.934118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:30.946856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cd33-42fc-4f82-87f8-5cba0a42cfdf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:30.948115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cd33-42fc-4f82-87f8-5cba0a42cfdf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:30.948630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3cd33-42fc-4f82-87f8-5cba0a42cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:30.953926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:30.953926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:30.953926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:30.977182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-53e3cd33-42fc-4f82-87f8-5cba0a42cfdf None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:30.978485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-53e3cd33-42fc-4f82-87f8-5cba0a42cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:30.983582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:30.984864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.004035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 774/1541] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.005805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c355c-2b11-406d-9947-2b2dbae17f50 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.006132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c355c-2b11-406d-9947-2b2dbae17f50 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.006414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c355c-2b11-406d-9947-2b2dbae17f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.012986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 768/1542] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:26:31.013925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.032295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99b1e4-0d9e-4fcc-a35d-9e78f67b296b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.046522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c07c355c-2b11-406d-9947-2b2dbae17f50 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.048579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c07c355c-2b11-406d-9947-2b2dbae17f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.052188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.052887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.053171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.053443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.054241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.054543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.056181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a8e6-5399-4c2e-88cb-f435d4837d07 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.070122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 775/1543] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.071594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.071892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.072175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.078506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 769/1544] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:31.079578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.079865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.080142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.105813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.107306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.119073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.120276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.124545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 776/1545] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.125252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.138960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155a912-5d92-4b2f-b703-320ece864525 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.139640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 770/1546] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.140496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.149511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.150155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.150443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.150721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.152093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.154249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.157420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bac492-1a8a-4adc-a32a-ded3cdae9bd3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.169710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.170776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.171054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.171320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.172060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.172360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.174212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.204847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 771/1547] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:31.205851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.225409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 777/1548] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.230627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.243948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad1e2-360b-4051-8acb-a2d53e3054fa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.402758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.403821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.404329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.404831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.405765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.406334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.408692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.428846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76529-a3c6-44be-bf50-495388ac44c9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.429207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 772/1549] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:31.430184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.445283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86856da8-c7b5-42a9-b4a7-a5db1e60376b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.446056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.446839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.447124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.447392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.448083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.450155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6058c9d-111f-4af1-b7dd-d9b1a4e94e9f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.458665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.458665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.458665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.458665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.459150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.460061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.505184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 778/1550] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/projects => generated 365 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.511563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423227-5ff7-4ecd-9680-24c5058571c0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.513439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423227-5ff7-4ecd-9680-24c5058571c0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.513981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423227-5ff7-4ecd-9680-24c5058571c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.517826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 773/1551] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.519411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.532234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7f5a-1884-4338-be0d-b0c6c4100ebb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.541767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-97423227-5ff7-4ecd-9680-24c5058571c0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.543097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-97423227-5ff7-4ecd-9680-24c5058571c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.590730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.591394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.591681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.591957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.592645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.593690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:31.593690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:26:31.593690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:26:31.594923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.601597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 779/1552] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.603007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.603298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.603565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.622479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.623716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.623868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 774/1553] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.624565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.645747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:31.668923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:31.688588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 780/1554] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.689413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.691830 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ced8c-dbeb-4118-b486-934a54721655 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.696529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.697235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.697519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.697786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.698500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.700399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bf8b5-a015-4926-b5cb-8b174ae9b68b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.700745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd7ae2-da26-4352-9f2c-d9547c144aa7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.705230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.705945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.706227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.706503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.707218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.708954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31e05-649f-4332-8711-c9080403817a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.724177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 775/1555] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.724374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 781/1556] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:31.724476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070fd-479b-4a28-b10e-ad87f8bb0795 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.724476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070fd-479b-4a28-b10e-ad87f8bb0795 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.724675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4919-b4c2-4542-9be7-3468109e0fc9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.724772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070fd-479b-4a28-b10e-ad87f8bb0795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.724862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4919-b4c2-4542-9be7-3468109e0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.724862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4919-b4c2-4542-9be7-3468109e0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.742294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-61c070fd-479b-4a28-b10e-ad87f8bb0795 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.742820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7baa4919-b4c2-4542-9be7-3468109e0fc9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.743499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-61c070fd-479b-4a28-b10e-ad87f8bb0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.744006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7baa4919-b4c2-4542-9be7-3468109e0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.751635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 776/1557] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.752539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 782/1558] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.754018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.754524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.754896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.755058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61534-683a-4a66-855a-498c7474ce1e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.755501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61534-683a-4a66-855a-498c7474ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.755931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e61534-683a-4a66-855a-498c7474ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.773022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.774226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.775125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-52e61534-683a-4a66-855a-498c7474ce1e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.776275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52e61534-683a-4a66-855a-498c7474ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.782014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 783/1559] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.782014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.786976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.791248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.791529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.791810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.792300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b17d-b8a9-4685-a7e6-bc3fc9fd2ede None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.796785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.797429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.797707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.798008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.798684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.799697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:31.799697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:26:31.799697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:26:31.800883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.810414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.811614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.820565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 778/1561] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.821109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 784/1562] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/users => generated 285 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:31.822043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.822953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.832683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a18c9f-2e2b-4487-9d8a-7ddc9d25c6bb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.833138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b2f3f-c0aa-4b8e-80fe-cfbab2c4dd76 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.837307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.837697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.837984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.838268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.838380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.838540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.838652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.838932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.839260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.839653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.840885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340b991-d740-4a47-bac4-8dc11d9d378d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.841235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523eaeb-c0e3-4db0-b4ed-669053b7cb81 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.851633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 785/1563] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:31.852101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 779/1564] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:31.853160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.853441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.853714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.853883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aa1b-bf63-4fa1-bc8a-c49a450483e6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.854363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aa1b-bf63-4fa1-bc8a-c49a450483e6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.855232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aa1b-bf63-4fa1-bc8a-c49a450483e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.872122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.873256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1907aa1b-bf63-4fa1-bc8a-c49a450483e6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.873383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.874439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1907aa1b-bf63-4fa1-bc8a-c49a450483e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.881323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 780/1565] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.882121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.886726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 786/1566] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.886726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.886726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.886726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.891591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a5063-650e-4b99-b13e-d4218b7bae40 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.896362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.897008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.897395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.897677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.898430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.898735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.900340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.904917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:31.912701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:31.916084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 787/1567] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:31.916890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.918516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 781/1568] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:31.920555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.927152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d4bd0-41c7-4e46-806e-308c9485315c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.931389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834193a-9a69-4bc5-a6d3-4b9d5cd09890 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.931829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.932512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.932796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.933067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.933921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.935521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.936075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.936720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.937002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.937274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.938022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.938330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.939904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.945443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 788/1569] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:31.946248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.954388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 782/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:31.955413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb11165-232b-4aff-9382-41133c349cff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.958494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.960172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.960817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.961343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.961343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.962105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.963682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.968146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf8d4-2c58-4434-8487-746d98bc531d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.972711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.974134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 789/1571] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:31.974249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.974473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.974742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:31.974867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] PATH_INFO: `/v3/projects/0bdc3492fd6d445080f99c7cb122ce5c/users/dfb1a8f4f6564510b9d4d3ca9f4362f9/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.983771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d86-5a75-42ad-a3db-e91564279e39 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:31.988389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:31.989655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:31.989957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:31.990113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdc3492fd6d445080f99c7cb122ce5c, user_id=dfb1a8f4f6564510b9d4d3ca9f4362f9, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.990219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:31.990920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:31.991158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:31.991158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:26:31.991158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:26:31.991446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:31.992188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:31.992188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:26:31.992188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:26:31.993046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:31.993167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.005932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 790/1572] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:32.006975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 783/1573] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:31 2022] PUT /identity/v3/projects/0bdc3492fd6d445080f99c7cb122ce5c/users/dfb1a8f4f6564510b9d4d3ca9f4362f9/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:32.007116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.007653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.016550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcbc4c-1d50-4eee-9731-bd2ef3c9106e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.071193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be476-6a88-4c5b-9016-f823fa44354f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.073761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.074464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.074747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.075024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.075746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:32.075901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.076209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.076560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.076847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.077154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.077821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.078158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:32.078477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.080320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.090137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 791/1574] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:32.091020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.100200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 784/1575] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:32.101068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b583-5f6b-4e3c-8bca-0309c300d123 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.101221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.106014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.106661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.107019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.107298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.107970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.109867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.112031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77505c57-beac-45f8-935f-d786be86beb0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.116984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.117657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.117967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.118250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.119408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.121241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.126931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.134374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 785/1576] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.135438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.141567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 792/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.141567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.147480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c80d6-0b6c-46ec-a929-f8a4111b301e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.157131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.202327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d901ce-fe9a-43fb-b6f0-0194cf02f28f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.203396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.204060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.204344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.204621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.205306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.207000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.208202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1717-b46e-4534-b0d1-d7e9bfd933b0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.208410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.208688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.208957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] PATH_INFO: `/v3/projects/0cc67e47e01b4a4baed18893678b1974/users/4ae95c2f82b048c8b8069234df48d55b/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.225310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc67e47e01b4a4baed18893678b1974, user_id=4ae95c2f82b048c8b8069234df48d55b, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.228188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.236027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 786/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.237581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.237872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.238176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.244453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 793/1579] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:32 2022] PUT /identity/v3/projects/0cc67e47e01b4a4baed18893678b1974/users/4ae95c2f82b048c8b8069234df48d55b/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:32.245419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.256432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:32.257650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:32.317371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 787/1580] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:32.318232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.324367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4095-c842-4a16-afe9-999a5a93fd3c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.327240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a900e-b3a8-49f7-8892-a19637ae002f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.329274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.329961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.330353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.330532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.331225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.331946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.333151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.333441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.333711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.333827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.334425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.336329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.359960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 794/1581] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.360771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.364012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 788/1582] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.364893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.423225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad36d-9ab8-4b16-8113-b5c0deb8e22d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.428631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.429275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afed1-223c-437e-8881-4d1c9e9c37aa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.429391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.429560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.429840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.430554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.432453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.433855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.434768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.435054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.435330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] PATH_INFO: `/v3/projects/4f2899cafc714aca974a5a7453998dc4/users/9df10b058419436297d8eaca5cbcfce4/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.444153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.453069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2899cafc714aca974a5a7453998dc4, user_id=9df10b058419436297d8eaca5cbcfce4, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.456213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.458221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 795/1583] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.458860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.468566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.471823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 789/1584] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:32 2022] PUT /identity/v3/projects/4f2899cafc714aca974a5a7453998dc4/users/9df10b058419436297d8eaca5cbcfce4/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:32.472620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.524950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135ec0-2f17-490f-9672-9640ccb1c2b6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.538372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f816-c5f6-47e2-852d-b782c15d1bf2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.542987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.543659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.543945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.544223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.544909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.546894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e7b13-b765-4cb8-82a8-5ed7be5804cc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.569837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 790/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.569837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.569837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.569837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.582128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.582832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.583114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.583386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.584070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.586019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.594902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] MFA Rules not processed for user `4ae95c2f82b048c8b8069234df48d55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:32.596110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:32.609682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 796/1586] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.609682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.672085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554d50-7e28-4925-93d3-34281c39e738 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.672911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 791/1587] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:32.673793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.680163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.680814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.681094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.681363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.688098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9657d-bd8c-4105-9f2b-c79deb7a051d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.690850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.692826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.693295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.693983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.694267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.694539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.695224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.697172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.702539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 797/1588] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:32.703258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.713558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60af3f-afe6-4832-b9cf-d49c2b5ea240 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.718235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.718891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.719171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.719441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.719876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 792/1589] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.720197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.720500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.722203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99bb26-38eb-4391-86ab-ab33d2249e3f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.731096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58adfeb-a6bd-411d-9b4a-4a3da1767bc3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.736198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.736823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.737143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.737419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.738281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.740590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.752250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 798/1590] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.752250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.752250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.752250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.765655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 793/1591] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:32.766674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.778282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728db7ff-4286-4c6f-b3a4-41714798c090 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.783293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.784016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.784159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] MFA Rules not processed for user `9df10b058419436297d8eaca5cbcfce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:32.784449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.784813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.785525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:32.785712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.787436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.799636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 794/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.800697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.809560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.812135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8473-9445-4642-add8-46ba1e825606 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.818570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.819859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.820269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.820790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.821623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.823362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.834690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 795/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.835431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.848274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:32.866705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 799/1594] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:32.867761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.883113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f10b-738f-42ab-8970-f2112a37ed5b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.888230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.889017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.889409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.890167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.890806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.892636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.903808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 800/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.904225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23293-b907-4b53-b177-d82d08dcc815 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.907504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.908149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.908806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.909163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.909375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.921308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb724-80aa-4f87-b8e5-ca7f53e7e7f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.923148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.925163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.932365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.933233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.933624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.934038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.934873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.936590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.939496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 796/1596] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:32.951941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 801/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.951941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.952320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.963758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7294a8c-5c5b-4a14-aacf-824f6db4efc9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.966077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a206-3768-4e23-b70c-7aa25d5f8ef1 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:32.968789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.969534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.969886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.970379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.971196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.971319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:32.972115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:32.972572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:32.972845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:32.973313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.974210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:32.976298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:32.986263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 802/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.987587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:32.993980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 797/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:32.993980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.002601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d235f-40f0-4e4e-829e-c37bf52be0a7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.008566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.009243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.009553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.009931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.010688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.012586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.017839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14d30-598a-4ba4-a17c-bd8be9962170 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.032395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.033159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.033491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.033811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.037459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.039371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.046062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 798/1600] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:33.047094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.061602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 803/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:33.062379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.077402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87e0c-252e-404c-b063-c7614b1de4b7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.158804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.159507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.159792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.160068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.161208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.163519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.176538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 804/1602] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:33.181846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.194872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2fe16-d7f5-437d-ac76-9ede672fe016 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.200575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.201932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.202243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.202545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] PATH_INFO: `/v3/projects/a16acec6b0754440826cca1108e4d377/users/855568cbf9da4d3680a1f212fa9e4222/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.223995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16acec6b0754440826cca1108e4d377, user_id=855568cbf9da4d3680a1f212fa9e4222, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.226813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.261766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 805/1603] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:33 2022] PUT /identity/v3/projects/a16acec6b0754440826cca1108e4d377/users/855568cbf9da4d3680a1f212fa9e4222/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:33.263246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.291754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041edb4-0442-4e17-bb75-e318be8c1436 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.346986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.364391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f90cb-2966-4f9c-883a-79500d76656e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.369604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.370298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.370580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.370852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.371706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.373471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.374099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.374911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.375294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.376002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.376835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.379223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.387632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 806/1604] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:33.388917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.391214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 799/1605] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:33.392116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.404868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a16d2-d43e-4f7a-80b8-b4350b41efc9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.406853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986bc8-ce2e-4635-8043-278279605465 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.411561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.412867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.413347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.413767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] PATH_INFO: `/v3/projects/59da0e60fc7c4991971657f99f8cd049/users/d840508b8ac5473aa066d2d77d98d27c/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.415029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.415837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.416187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.416640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.418171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.425269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.433741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59da0e60fc7c4991971657f99f8cd049, user_id=d840508b8ac5473aa066d2d77d98d27c, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.437400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72968952-e964-47b7-b389-19f8459bbd78 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.451665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.455482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 807/1606] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:33 2022] POST /identity/v3/users => generated 290 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:33.456308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.470427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 800/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:33 2022] PUT /identity/v3/projects/59da0e60fc7c4991971657f99f8cd049/users/d840508b8ac5473aa066d2d77d98d27c/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:33.471949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.472243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.475099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.478950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d4f0-7d36-4965-9478-b743ebd807af admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.501312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:33.502751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:33.573071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.574165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.574550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.574955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] PATH_INFO: `/v3/projects/fad462f254ef42e6a67dc4de21ed2a2d/users/d79e251952bb4791a04ce88e90c11dbd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.584270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 801/1608] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:33.585462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.601132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad462f254ef42e6a67dc4de21ed2a2d, user_id=d79e251952bb4791a04ce88e90c11dbd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.605241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.612927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033081a-c14f-4f08-923b-29598995edd9 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.619078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.630660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.630660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.630660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] PATH_INFO: `/v3/projects/c2bd7813116045c19b5449507e62b6c3/users/03f5cc85550e4e93a76c7415f2ee3741/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.640704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 808/1609] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:33 2022] PUT /identity/v3/projects/fad462f254ef42e6a67dc4de21ed2a2d/users/d79e251952bb4791a04ce88e90c11dbd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:33.641686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.650827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bd7813116045c19b5449507e62b6c3, user_id=03f5cc85550e4e93a76c7415f2ee3741, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.654173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.677378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 802/1610] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:33 2022] PUT /identity/v3/projects/c2bd7813116045c19b5449507e62b6c3/users/03f5cc85550e4e93a76c7415f2ee3741/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:33.678566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.802899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e41bc-5643-42a1-be33-2b11be052b50 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.810004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c81aa-1b65-428b-b6f7-0361a13e106b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.822618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.825515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.825810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.826108 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] PATH_INFO: `/v3/projects/d1624b1186184b1bb8e927f44d33f08a/users/789516a0875a4925b6dcf62550aabad9/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.828273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.829187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.831826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.832252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.834108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.836497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d42e9-f6c5-4ff8-ad0d-a45aa7bc931b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.858790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 803/1611] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:33.861951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1624b1186184b1bb8e927f44d33f08a, user_id=789516a0875a4925b6dcf62550aabad9, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:33.865629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e945-4582-4a1b-bdc0-1a6fbefc3655 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.865927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e945-4582-4a1b-bdc0-1a6fbefc3655 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.866214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e945-4582-4a1b-bdc0-1a6fbefc3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:33.867313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:33.900337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 809/1612] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:33 2022] PUT /identity/v3/projects/d1624b1186184b1bb8e927f44d33f08a/users/789516a0875a4925b6dcf62550aabad9/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:33.902543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:33.916704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4474e945-4582-4a1b-bdc0-1a6fbefc3655 None None] MFA Rules not processed for user `d840508b8ac5473aa066d2d77d98d27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:33.918546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4474e945-4582-4a1b-bdc0-1a6fbefc3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:33.950979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:33.984347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f97c-bb03-467e-bc4f-8baea870ff65 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:33.990853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:33.991482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:33.991700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:33.991976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.002882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:34.008227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 804/1613] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:34.009685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926137e-9921-43db-827f-152643f3927c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.010464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926137e-9921-43db-827f-152643f3927c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.011764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926137e-9921-43db-827f-152643f3927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.038396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d926137e-9921-43db-827f-152643f3927c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:34.040794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d926137e-9921-43db-827f-152643f3927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:34.072320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.074173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba1afb-cb3d-4f7b-bb9d-ad6535fb8336 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.092777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 810/1614] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:34.095002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.095364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.095825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.120080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 805/1615] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:34.121041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926137e-9921-43db-827f-152643f3927c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.133490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] MFA Rules not processed for user `03f5cc85550e4e93a76c7415f2ee3741`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:34.135220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:34.140477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926137e-9921-43db-827f-152643f3927c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.146395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.147679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.147966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.148239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] PATH_INFO: `/v3/projects/84a056ee35c04be8add66e4513af4a24/users/f581317dbcb44a2685b6a3f8aa0693b9/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.179993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a056ee35c04be8add66e4513af4a24, user_id=f581317dbcb44a2685b6a3f8aa0693b9, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.183998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f358a-c499-41bf-9ad3-14c5a4a24939 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.216609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 806/1616] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:34 2022] PUT /identity/v3/projects/84a056ee35c04be8add66e4513af4a24/users/f581317dbcb44a2685b6a3f8aa0693b9/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:34.218151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.218559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.218936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.238650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 811/1617] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:34.240898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.249717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:34.251407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:34.284653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b0b8-f3c2-4073-a3a4-d14c9207d12b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.374693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 807/1618] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:34.375917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.376259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.376454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.376932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.377404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.378450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.378844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:34.381596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.407906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:34.417067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 812/1619] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:34.418085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.465493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6fdbe-221f-46bb-932b-e91c13026f5d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.510352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8d29-a151-44b2-8f61-236a0f9eecb7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.512337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:34.518201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.518880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.519545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.519840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.522279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.523976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043d3e-9bcf-4760-8621-f11b2afc4be6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.542299 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 813/1620] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:34.543478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.544142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.544483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.544754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.545584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9f7e-d1ee-42b7-897e-953df7438e2e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.548656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9f7e-d1ee-42b7-897e-953df7438e2e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.549377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9f7e-d1ee-42b7-897e-953df7438e2e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.551425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 814/1621] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 15:26:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:34.552541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b9f7e-d1ee-42b7-897e-953df7438e2e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.565696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.566424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b9f7e-d1ee-42b7-897e-953df7438e2e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.567418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.576243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.577057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.578218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.578673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.592959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 808/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:34.594025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.609042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.610377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a93a-8c19-4757-ab3e-2ab4ee941478 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.611470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.616376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.617228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.617511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.618081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.622677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.626100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6382c6-e548-4532-a9fa-4abe964acaf7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.630316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 815/1623] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:34.631245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.656695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d25-89f4-4a54-b9b2-ce9d6f8d3f40 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:34.673569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 809/1624] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:34.675188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2888e-6c0c-4f34-9d43-c7578b7a3ef7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.675592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2888e-6c0c-4f34-9d43-c7578b7a3ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.676044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:34.676248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2888e-6c0c-4f34-9d43-c7578b7a3ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.677115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.677406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.677689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] PATH_INFO: `/v3/projects/84a056ee35c04be8add66e4513af4a24/users/f581317dbcb44a2685b6a3f8aa0693b9/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.679881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a056ee35c04be8add66e4513af4a24, user_id=f581317dbcb44a2685b6a3f8aa0693b9, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:34.682602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:34.694803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 816/1625] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:34 2022] PUT /identity/v3/projects/84a056ee35c04be8add66e4513af4a24/users/f581317dbcb44a2685b6a3f8aa0693b9/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:34.706251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:34.728310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-efc2888e-6c0c-4f34-9d43-c7578b7a3ef7 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:34.731087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-efc2888e-6c0c-4f34-9d43-c7578b7a3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 810/1626] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] MFA Rules not processed for user `f581317dbcb44a2685b6a3f8aa0693b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:34.977346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:35.124164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 811/1627] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:35.129046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.151258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b94ca-a79c-47d9-a0e5-2ae984cfffaa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.157595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.158067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.158354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.158639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.173310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb286-b296-43f5-bada-176b96feadbc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.185794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.187103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.189545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.190034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.190893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.196375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.207243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:35.224532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 817/1628] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:35.227296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.248645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.251357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.263511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 812/1629] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:35.264393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.275710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ceaac-7c46-4753-8fc7-81e670c201ad service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.281000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.282432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.282713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.283399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] PATH_INFO: `/v3/projects/b129144da14e466fb754089da2dda444/users/4cc0481d77524cde94f4f7eb7edb190f/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.308488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b129144da14e466fb754089da2dda444, user_id=4cc0481d77524cde94f4f7eb7edb190f, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.312642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ca1c-5ae8-4151-b744-b79dffe7bcec admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.342712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 813/1630] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:35 2022] PUT /identity/v3/projects/b129144da14e466fb754089da2dda444/users/4cc0481d77524cde94f4f7eb7edb190f/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:35.344190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a0d5c-1e47-4a63-a4c1-66e52461dbe6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.344483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a0d5c-1e47-4a63-a4c1-66e52461dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.344761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a0d5c-1e47-4a63-a4c1-66e52461dbe6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.346185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 814/1631] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 15:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:35.346952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a0d5c-1e47-4a63-a4c1-66e52461dbe6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.389910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956bbd-a867-4c3f-ae58-ad6c813396a1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.420899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:35.464101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a0d5c-1e47-4a63-a4c1-66e52461dbe6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.471153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.472812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.473880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.474437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.475397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.477939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabe92-4651-4105-865c-ed4feacb3cb4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.493820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.494530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.494816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.495097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.497447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 815/1632] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:35.499260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0a9e-44e8-40ef-a176-f5f4aad753ff None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.499799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0a9e-44e8-40ef-a176-f5f4aad753ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.500568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0a9e-44e8-40ef-a176-f5f4aad753ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.538120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cccf0a9e-44e8-40ef-a176-f5f4aad753ff None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:35.541117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cccf0a9e-44e8-40ef-a176-f5f4aad753ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:35.581700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.584150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.610444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 818/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:35.612831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.639160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d61445-8af3-440e-8ea5-054f35214371 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.654055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.656841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.657167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.657450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] PATH_INFO: `/v3/projects/b129144da14e466fb754089da2dda444/users/4cc0481d77524cde94f4f7eb7edb190f/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.663833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b129144da14e466fb754089da2dda444, user_id=4cc0481d77524cde94f4f7eb7edb190f, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:35.673302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:35.727107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 819/1634] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:35 2022] PUT /identity/v3/projects/b129144da14e466fb754089da2dda444/users/4cc0481d77524cde94f4f7eb7edb190f/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:35.733035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:35.758210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 816/1635] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:35.760466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ef10-41f7-4a13-a98c-8779918fed2f None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.763873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ef10-41f7-4a13-a98c-8779918fed2f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.767752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ef10-41f7-4a13-a98c-8779918fed2f None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.770827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 817/1636] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 15:26:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:35.772733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ce87-715c-4459-85ee-56a383815394 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.774244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ce87-715c-4459-85ee-56a383815394 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.775091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ce87-715c-4459-85ee-56a383815394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.830950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1b95ce87-715c-4459-85ee-56a383815394 None None] MFA Rules not processed for user `4cc0481d77524cde94f4f7eb7edb190f`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:35.833144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1b95ce87-715c-4459-85ee-56a383815394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:35.882591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:35.891193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b005-ec8a-4d9b-b7e3-b88ea6dd0791 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:35.895717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:35.896379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.896665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.896943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.958507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 818/1637] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:35.959975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efd5-b824-4334-ad53-5dbc6638a166 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.960267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efd5-b824-4334-ad53-5dbc6638a166 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.960540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666efd5-b824-4334-ad53-5dbc6638a166 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:35.968530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 819/1638] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 15:26:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:35.971115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:35.971407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:35.971688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:36.009353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:36.010708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:36.035425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:36.038654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b614fd-dd0c-4dc2-8280-15017f584e0a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:36.055248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 820/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:36.056737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:36.057129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:36.058026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:36.087837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:36.089360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:36.098192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:36.147773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 820/1640] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:36.148998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:36.173281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6565d8-be0b-49a3-93c2-5dcfee228e8b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:36.183646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:36.187496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:36.187872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:36.188259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:36.209578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:36.214700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:36.243837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 821/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:36.280929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 821/1642] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:36.293064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:36.311466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4d9ab-ceb2-4698-9a94-e692bcc21174 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:36.318992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:36.321219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:36.322929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:36.323683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:36.349560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:36.355834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:36.406661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 822/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:36.813231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:36.827492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f5e74-2222-46a7-b4cc-26fb4eb7a648 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:36.838062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:36.840244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:36.841454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:36.843474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:36.870406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:36.872129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:36.909880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 822/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:37.025207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:37.036312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1b19-d510-4456-a5ed-e7c001a89573 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:37.043484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:37.044147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:37.045930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:37.046482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:37.243825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:37.245730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068c37-bb0a-4b3a-9c7f-b406f261f8e2 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:37.275547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 823/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:40.676361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:40.814671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63363-ed50-4ec9-bd34-659d64a8727a service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:40.831875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:40.833509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:40.833795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:40.834092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] PATH_INFO: `/v3/users/03f5cc85550e4e93a76c7415f2ee3741` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:40.835344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f5cc85550e4e93a76c7415f2ee3741)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:40.837293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:40.963836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f5cc85550e4e93a76c7415f2ee3741'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:40.964538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f5cc85550e4e93a76c7415f2ee3741'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:40.965161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f5cc85550e4e93a76c7415f2ee3741'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:40.985329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f5cc85550e4e93a76c7415f2ee3741'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.003899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f5cc85550e4e93a76c7415f2ee3741'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.050118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 823/1646] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:40 2022] DELETE /identity/v3/users/03f5cc85550e4e93a76c7415f2ee3741 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:41.053094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:41.053567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:41.053650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:41.096079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:41.099551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:41.172060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:41.261594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 824/1647] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:41.323609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:41.327209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:41.358357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:41.365360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:41.366832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:41.392308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eeba6-5768-4c7f-a7ec-529253282427 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:41.419753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:41.420661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:41.420937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:41.421207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] PATH_INFO: `/v3/users/9df10b058419436297d8eaca5cbcfce4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:41.423823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df10b058419436297d8eaca5cbcfce4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:41.425104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: WARNING py.warnings [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:41.425104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: warnings.warn(msg) Jul 06 15:26:41.425104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: Jul 06 15:26:41.427258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:41.533276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96bc06-6480-49fa-a328-cfa435f2136e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:41.540716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:41.542575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:41.543683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:41.544643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:41.581280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:41.583690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9863f-8ac7-4dcc-88b2-5caa5d65ffca service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:41.619114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 824/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:41.641392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df10b058419436297d8eaca5cbcfce4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.643488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df10b058419436297d8eaca5cbcfce4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.645222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df10b058419436297d8eaca5cbcfce4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.701933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df10b058419436297d8eaca5cbcfce4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.736475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df10b058419436297d8eaca5cbcfce4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:41.771116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 825/1649] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:41 2022] DELETE /identity/v3/users/9df10b058419436297d8eaca5cbcfce4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:41.776358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:41.776838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:41.776994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:41.821846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:41.826169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:42.015279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 825/1650] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:42.084502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:42.086070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:42.271924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cea89c-f619-4fac-a146-27d948e1dfe3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:42.288943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:42.289627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:42.289923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:42.290265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:42.334516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:42.335988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:42.369541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 826/1651] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:43.969535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:43.971605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:44.003427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a27a3d-402a-4922-bd44-c103f20d3ed5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:44.029074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:44.030265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:44.030591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:44.031902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] PATH_INFO: `/v3/projects/4f2899cafc714aca974a5a7453998dc4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:44.033718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2899cafc714aca974a5a7453998dc4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:44.037368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: WARNING py.warnings [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 15:26:44.037368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: warnings.warn(msg) Jul 06 15:26:44.037368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: Jul 06 15:26:44.038963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:44.186760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2899cafc714aca974a5a7453998dc4', 'request_id': 'req-125add4f-8a5b-4eca-8811-ec3846973858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.197069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2899cafc714aca974a5a7453998dc4', 'request_id': 'req-125add4f-8a5b-4eca-8811-ec3846973858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.233780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2899cafc714aca974a5a7453998dc4', 'request_id': 'req-125add4f-8a5b-4eca-8811-ec3846973858'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.264952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] The token cache is being invalidate because project 4f2899cafc714aca974a5a7453998dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:44.265484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.266944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-125add4f-8a5b-4eca-8811-ec3846973858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.273635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 826/1652] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:43 2022] DELETE /identity/v3/projects/4f2899cafc714aca974a5a7453998dc4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:44.274944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:44.292511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a93c6-d7b1-4e1e-a641-1c6a1cd5528b service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:44.396686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:44.429510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:44.430490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:44.430782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:44.431102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] PATH_INFO: `/v3/users/f581317dbcb44a2685b6a3f8aa0693b9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:44.434685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f581317dbcb44a2685b6a3f8aa0693b9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:44.436666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:44.543649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f581317dbcb44a2685b6a3f8aa0693b9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.552653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f581317dbcb44a2685b6a3f8aa0693b9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.553432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f581317dbcb44a2685b6a3f8aa0693b9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.577084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f581317dbcb44a2685b6a3f8aa0693b9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.595149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f581317dbcb44a2685b6a3f8aa0693b9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:44.627092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 827/1653] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:44 2022] DELETE /identity/v3/users/f581317dbcb44a2685b6a3f8aa0693b9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:44.882680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3beab1-50b2-43ce-9dc7-f8be720e2c4f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:44.883107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3beab1-50b2-43ce-9dc7-f8be720e2c4f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:44.883510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3beab1-50b2-43ce-9dc7-f8be720e2c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:44.926913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:44.930132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:44.953626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2c3beab1-50b2-43ce-9dc7-f8be720e2c4f None None] MFA Rules not processed for user `dfb1a8f4f6564510b9d4d3ca9f4362f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:44.964606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2c3beab1-50b2-43ce-9dc7-f8be720e2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.026265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:45.151949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92d03-e278-4701-a2fc-f7a57dd1db3a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:45.157367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 827/1654] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:45.161940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:45.161940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.161940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.162245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] PATH_INFO: `/v3/projects/c2bd7813116045c19b5449507e62b6c3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.163849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2bd7813116045c19b5449507e62b6c3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:45.165421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:45.169603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.169603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.170904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.209817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] MFA Rules not processed for user `dfb1a8f4f6564510b9d4d3ca9f4362f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:45.213973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.245006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 828/1655] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:26:45.260473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:45.263074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.268767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bd7813116045c19b5449507e62b6c3', 'request_id': 'req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:45.283270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bd7813116045c19b5449507e62b6c3', 'request_id': 'req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:45.291700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:45.303191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bd7813116045c19b5449507e62b6c3', 'request_id': 'req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:45.322948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] The token cache is being invalidate because project c2bd7813116045c19b5449507e62b6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:45.323524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:45.324866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-2b6b8914-2b37-43eb-a8c2-8f6831a8e652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:45.327606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 828/1656] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:44 2022] DELETE /identity/v3/projects/c2bd7813116045c19b5449507e62b6c3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:45.335661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6f1a-e273-4849-a4a6-4554bc34d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.339155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6f1a-e273-4849-a4a6-4554bc34d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.344840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6f1a-e273-4849-a4a6-4554bc34d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.416136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d6ff6f1a-e273-4849-a4a6-4554bc34d6f9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:45.417540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d6ff6f1a-e273-4849-a4a6-4554bc34d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.515136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76dcf-64d5-47f8-b15e-a35b3882e3f2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:45.521287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 829/1657] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:45.529545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.529829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.530161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.586150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:45.593164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.615718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 830/1658] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:45.620229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:45.648834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd318cf1-e3bd-4032-bd4a-0ea71508b7d8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:45.669755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:45.670744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.671235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.671786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.673610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:45.675608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:45.679589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:45.687021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:45.687745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.690208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.690634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.696125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:45.713731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 831/1659] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:45.718921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:45.744223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a069-1f43-4a17-9da9-cc03f21d0d6e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:45.759259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:45.762181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:45.762644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:45.763066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:45.765716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:45.768221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:45.831965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:45.839348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:45.844131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:45.870343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 829/1660] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:26:45.875437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 832/1661] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:45 2022] POST /identity/v3/projects => generated 357 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:45.894983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:45.934786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46b55-b0f8-457b-899e-6b792473442b service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.105149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.105935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.106490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.106912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.107856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.110942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.170327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.172126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 830/1662] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:45 2022] POST /identity/v3/users => generated 279 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:46.186083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c907c6c-36b0-4181-8638-1852e8db479f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.208683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.209410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.209693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.209995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.211537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.213183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.257815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 833/1663] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:46.262146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.278482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2560-04d8-4646-b8ee-f6eccf8844fc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.311923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.312629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.312915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.313191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.314070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.315686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9d87c-5f37-4906-ad22-3ee6d922f97e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.352756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 831/1664] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:46.354086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.367964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc70e6-644c-4298-98b9-6c94ce1f0bcd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.389997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.390931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.391241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.391556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] PATH_INFO: `/v3/projects/00d04f323e124d9ea251f48457416ab2/users/e9bbce269d5e4119ab44495ed4752859/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.429784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d04f323e124d9ea251f48457416ab2, user_id=e9bbce269d5e4119ab44495ed4752859, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.432709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.471314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 834/1665] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:46 2022] PUT /identity/v3/projects/00d04f323e124d9ea251f48457416ab2/users/e9bbce269d5e4119ab44495ed4752859/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:46.475567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.475951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.476236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.517737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.520399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:46.563458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] MFA Rules not processed for user `e9bbce269d5e4119ab44495ed4752859`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:46.564648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:46.731150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d3c7-c8e1-45fc-afeb-707b05371445 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.742367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.743737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.744220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.744709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] PATH_INFO: `/v3/users/d840508b8ac5473aa066d2d77d98d27c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.746201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d840508b8ac5473aa066d2d77d98d27c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.748359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.764543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:46.764543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.764543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:46.787995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:46.790759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa180b-7bcd-4dc2-bc0e-d13105c5e44e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:46.801924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:46.804086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:46.804675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:46.805152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] PATH_INFO: `/v3/projects/84a056ee35c04be8add66e4513af4a24` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:46.807867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a056ee35c04be8add66e4513af4a24)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:46.810617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:46.868340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd840508b8ac5473aa066d2d77d98d27c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.869454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd840508b8ac5473aa066d2d77d98d27c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.870391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd840508b8ac5473aa066d2d77d98d27c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.910352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd840508b8ac5473aa066d2d77d98d27c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.930063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a056ee35c04be8add66e4513af4a24', 'request_id': 'req-b534d778-36b6-48c9-94d1-fd0046dd9e59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.942581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd840508b8ac5473aa066d2d77d98d27c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.946861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:46.950048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a056ee35c04be8add66e4513af4a24', 'request_id': 'req-b534d778-36b6-48c9-94d1-fd0046dd9e59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.961187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a056ee35c04be8add66e4513af4a24', 'request_id': 'req-b534d778-36b6-48c9-94d1-fd0046dd9e59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.974045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 835/1667] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:46 2022] DELETE /identity/v3/users/d840508b8ac5473aa066d2d77d98d27c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:46.975301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:46.979657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:46.997730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] The token cache is being invalidate because project 84a056ee35c04be8add66e4513af4a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:46.998378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:46.999563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b534d778-36b6-48c9-94d1-fd0046dd9e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.008394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 833/1668] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:46 2022] DELETE /identity/v3/projects/84a056ee35c04be8add66e4513af4a24 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:47.011150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1015-5465-42ea-a270-9942dcedfc57 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.017467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1015-5465-42ea-a270-9942dcedfc57 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.018097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf1015-5465-42ea-a270-9942dcedfc57 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.028577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 834/1669] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 15:26:47 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:47.031598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad5236-7c51-4161-94e6-92917234e10c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.032791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad5236-7c51-4161-94e6-92917234e10c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.033281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad5236-7c51-4161-94e6-92917234e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.078090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ecad5236-7c51-4161-94e6-92917234e10c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:47.085480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ecad5236-7c51-4161-94e6-92917234e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.155966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dd318-12d0-4fb7-b1c8-038b55181ce7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:47.167850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:47.168803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.169190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.169563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.170660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:47.173202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17164b-6ec4-4f76-b38c-6b95c8b6b70c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:47.221732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 836/1670] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:46 2022] POST /identity/v3/projects => generated 357 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:47.227287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.229951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.230651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.276687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:47.278116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.289604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 835/1671] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:47.294866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.295318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.295735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.326205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:47.327959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.432634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 837/1672] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:47.433674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:47.437119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.450869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 836/1673] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:47.452588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:47.456724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.469479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c84fb4-04b5-4213-9e8e-8e9e5d6e5328 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:47.485405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:47.486127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.486409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.486681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.487385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:47.489925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:47.493693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd771e4e-f547-4fcc-b228-1a73ba24ead2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:47.503357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:47.505368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.506698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.506984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] PATH_INFO: `/v3/users/4ae95c2f82b048c8b8069234df48d55b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.510555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae95c2f82b048c8b8069234df48d55b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:47.517791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:47.542023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 838/1674] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:47 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:47.543026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:47.546685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.568138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:47.582293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bbaf4-0cd2-4403-a87f-9d247faf53d1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:47.590369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:47.591191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.591597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.592286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.637278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:47.645183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa7f70-2cb3-43cb-9f9f-1b8c86f4e0ea service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:47.654123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae95c2f82b048c8b8069234df48d55b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.654827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae95c2f82b048c8b8069234df48d55b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.658244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae95c2f82b048c8b8069234df48d55b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.680284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 839/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:47.683629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.683842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae95c2f82b048c8b8069234df48d55b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.683940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.684132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.705180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae95c2f82b048c8b8069234df48d55b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:47.736740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:47.740250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.749044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 837/1676] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:47 2022] DELETE /identity/v3/users/4ae95c2f82b048c8b8069234df48d55b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:47.750388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:47.763203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.796611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:47.932230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494b43-8b18-43c1-b74f-3378eb2bb1d6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:47.943401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:47.944012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:47.944831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:47.944831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:47.950515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.961540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 840/1677] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:47.963254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:47.968444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:47.976836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:47.978478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e058-d7db-463b-b1fc-f1bfe536df9e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:47.995047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dd23f-5c13-432f-a44c-3bfec5285103 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.001391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 838/1678] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:48.003239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.003581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.003898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.021984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.024058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.030326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.030718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.031832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.033135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.044600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:48.045800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:48.065458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 841/1679] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:48.069159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.076916 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 839/1680] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:48.077623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.091342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99566ad7-4867-4fec-a409-eca6a94ef5a6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.096490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.098243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.098531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.098809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.099546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:48.099851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.101455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.101808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76a9b-e603-45b1-a1f5-e7bc0e90d71d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.109451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.110384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.110664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.110934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] PATH_INFO: `/v3/projects/be657d46c06e4663852edec29dc0eda0/users/939f2e9846154e1bb2bfd8f82b919c8d/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.117723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 842/1681] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:48.122348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.142771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1228c-e667-4921-b6bf-e8db669a4b4d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.147315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be657d46c06e4663852edec29dc0eda0, user_id=939f2e9846154e1bb2bfd8f82b919c8d, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.150091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.159865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.160578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.160948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.161146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.161824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.164223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.182605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 840/1682] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:48 2022] PUT /identity/v3/projects/be657d46c06e4663852edec29dc0eda0/users/939f2e9846154e1bb2bfd8f82b919c8d/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:48.183517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.189828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:48.233602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 843/1683] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:48 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:48.239337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.322941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd9ef5-243b-48e1-90a8-a2385bba303f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.402854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf8e0d-2fe6-4069-ae21-f3a1438e3f07 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.416935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.420052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.420462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.420754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.421516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.425055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.446899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.447590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.447927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.448463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.449781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 844/1684] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:48.450836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.475199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.478233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.483195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a55ef9-cdc4-4d95-b909-caaa7caba051 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.509461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.512245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.514617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.515052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.517700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.524755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.533602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 841/1685] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:48.536586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.577562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806846fd-121b-4457-829e-b096e87a922b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.604724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.605729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 845/1686] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:48 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:48.606741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.608788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.609100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.609384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] PATH_INFO: `/v3/projects/be657d46c06e4663852edec29dc0eda0/users/939f2e9846154e1bb2bfd8f82b919c8d/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.618561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be657d46c06e4663852edec29dc0eda0, user_id=939f2e9846154e1bb2bfd8f82b919c8d, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.633878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe07ad1-8447-496a-b2a8-52537015a90d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.646117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e988e-41ff-4ea1-9216-5ac39e34e519 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.670241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:48.672172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.672461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.672743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.673495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:48.683864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:48.694889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 842/1687] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:48 2022] PUT /identity/v3/projects/be657d46c06e4663852edec29dc0eda0/users/939f2e9846154e1bb2bfd8f82b919c8d/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:48.703278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:48.703597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:48.704836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:48.724673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 846/1688] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:48.733875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:48.753867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1112-1030-407e-b694-042b4dc77ad8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:48.776573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] MFA Rules not processed for user `939f2e9846154e1bb2bfd8f82b919c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:48.777828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:48.782447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:48.817889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:49.059726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:49.060425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.061120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.061120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.063501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:49.074503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:49.088198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 843/1689] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:49.101081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:49.104201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 847/1690] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:49.105414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:49.108668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:49.133809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab9c-0455-4159-a3f2-ddf77b9deb22 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:49.145223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:49.146681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.146681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.146681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] PATH_INFO: `/v3/projects/42717d3de4e14f4e8df8fbb7c8f691ff/users/e425186356c641f7a04014ad86ae4fa0/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.192950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] RBAC: Authorizing `identity:create_grant(project_id=42717d3de4e14f4e8df8fbb7c8f691ff, user_id=e425186356c641f7a04014ad86ae4fa0, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:49.198882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8d76-431b-4e4d-8ebf-5a76c9e563af admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:49.239880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 848/1691] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:49 2022] PUT /identity/v3/projects/42717d3de4e14f4e8df8fbb7c8f691ff/users/e425186356c641f7a04014ad86ae4fa0/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:49.273746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.274449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.275895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.365329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] MFA Rules not processed for user `e425186356c641f7a04014ad86ae4fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:49.366962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:49.383131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c1ad6-32e9-44cc-b88b-ce6e8eb2beb7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:49.546293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:49.546977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.547396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.547991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.580475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 849/1692] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:49.581350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:49.606919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:49.687068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:49.688719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:49.752620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 844/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:49.759451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:49.789724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ebb41-b6ac-49d5-a8c9-9e544baae56f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:49.802352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:49.803264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.803615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.803808 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] PATH_INFO: `/v3/projects/59da0e60fc7c4991971657f99f8cd049` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.811332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59da0e60fc7c4991971657f99f8cd049)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:49.814338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:49.818619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:49.878600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:49.904849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45583b2e-771a-4f46-a203-5f49fd78466f service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:49.911774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:49.913327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.913635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.913935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.914716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:49.916915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2376a-cd46-4261-99ec-a864e24b9df0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:49.956368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59da0e60fc7c4991971657f99f8cd049', 'request_id': 'req-c686f127-ca54-4602-81b0-c3e8ef130347'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:49.960205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 845/1694] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:49 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:49.962044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d823-c593-4aea-9c53-337ac2d4a13f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:49.963306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d823-c593-4aea-9c53-337ac2d4a13f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:49.963969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d823-c593-4aea-9c53-337ac2d4a13f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:49.968059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 846/1695] 10.222.0.25 () {54 vars in 960 bytes} [Wed Jul 6 15:26:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:49.976599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d823-c593-4aea-9c53-337ac2d4a13f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:49.978648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59da0e60fc7c4991971657f99f8cd049', 'request_id': 'req-c686f127-ca54-4602-81b0-c3e8ef130347'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.001593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59da0e60fc7c4991971657f99f8cd049', 'request_id': 'req-c686f127-ca54-4602-81b0-c3e8ef130347'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.025709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] The token cache is being invalidate because project 59da0e60fc7c4991971657f99f8cd049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:50.026091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.027384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.031641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 850/1696] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:49 2022] DELETE /identity/v3/projects/59da0e60fc7c4991971657f99f8cd049 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:50.033198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:50.036640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:50.151450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d823-c593-4aea-9c53-337ac2d4a13f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:50.158638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:50.159385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:50.159612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:50.159931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:50.163358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:50.253630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f127-ca54-4602-81b0-c3e8ef130347 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:50.396745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:50.398175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a66a-a9a5-4b92-b083-d5021e3027bc service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:50.431982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 847/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:50.442708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a801-fd9e-4d87-a6eb-2884ef2ade9c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:50.442708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a801-fd9e-4d87-a6eb-2884ef2ade9c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:50.442917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a801-fd9e-4d87-a6eb-2884ef2ade9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:50.456316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:50.460268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:50.460589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:50.460866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:50.461618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:50.477041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:50.527205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d277a801-fd9e-4d87-a6eb-2884ef2ade9c None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:50.528448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d277a801-fd9e-4d87-a6eb-2884ef2ade9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:50.569480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 851/1698] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:50 2022] POST /identity/v3/users => generated 295 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:50.570764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:50.573805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:50.604198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431240d5-6d60-4d63-98b2-3a3b8fbf7d56 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:50.617779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:50.618727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:50.619014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:50.619285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] PATH_INFO: `/v3/users/4cc0481d77524cde94f4f7eb7edb190f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:50.625507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc0481d77524cde94f4f7eb7edb190f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:50.629159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:50.677356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:50.734030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 848/1699] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Jul 6 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:50.737805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:50.743804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:50.744244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:50.804889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:50.841850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc0481d77524cde94f4f7eb7edb190f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.843578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc0481d77524cde94f4f7eb7edb190f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.845320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc0481d77524cde94f4f7eb7edb190f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.848596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] MFA Rules not processed for user `789516a0875a4925b6dcf62550aabad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:50.852613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:50.886534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc0481d77524cde94f4f7eb7edb190f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.901034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc0481d77524cde94f4f7eb7edb190f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:50.929993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 852/1700] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:50 2022] DELETE /identity/v3/users/4cc0481d77524cde94f4f7eb7edb190f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:50.938574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:50.963253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.032027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 849/1701] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:51.033221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:51.040176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.077493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085b4b3-976b-4b3e-b7a8-62cbbafd7b3c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.090646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d25d-64f6-437a-9068-4839d8063e6e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.109487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:51.117604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.118347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.118745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.119678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:51.124155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:51.144883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 853/1702] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:51.149736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:51.151850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.166846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4c1b-e6d9-418f-8f61-aa6b9d2659e3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.179590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:51.182556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.182839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.183658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] PATH_INFO: `/v3/projects/0cc67e47e01b4a4baed18893678b1974` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.187331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc67e47e01b4a4baed18893678b1974)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:51.192957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:51.245640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:51.249637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.250272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.250558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.256406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.292452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:51.294245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1cf29-7a87-4aba-aa8a-be4e506abd20 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:51.312897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc67e47e01b4a4baed18893678b1974', 'request_id': 'req-b186684c-5653-42da-a660-ffdf69b6629b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:51.318297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 850/1703] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:51.320905 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03afc5a-2b8a-4315-a764-a090ea85ff00 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.321365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03afc5a-2b8a-4315-a764-a090ea85ff00 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.321777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03afc5a-2b8a-4315-a764-a090ea85ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.322196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc67e47e01b4a4baed18893678b1974', 'request_id': 'req-b186684c-5653-42da-a660-ffdf69b6629b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:51.332841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc67e47e01b4a4baed18893678b1974', 'request_id': 'req-b186684c-5653-42da-a660-ffdf69b6629b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:51.349729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] The token cache is being invalidate because project 0cc67e47e01b4a4baed18893678b1974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:51.350072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:51.350949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b186684c-5653-42da-a660-ffdf69b6629b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:51.353021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 854/1704] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:51 2022] DELETE /identity/v3/projects/0cc67e47e01b4a4baed18893678b1974 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:51.354528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.354816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.355089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.356060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b03afc5a-2b8a-4315-a764-a090ea85ff00 None None] MFA Rules not processed for user `d79e251952bb4791a04ce88e90c11dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:51.357503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b03afc5a-2b8a-4315-a764-a090ea85ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.377867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] MFA Rules not processed for user `789516a0875a4925b6dcf62550aabad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:51.380840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.418334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:51.482405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 855/1705] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:51.483314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:51.487884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.541230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:51.549947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 851/1706] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:51.549947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.549947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.550273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.631265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:51.636038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.658673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91e0b-3109-4819-8c7e-041b1f1ffc94 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.666406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:51.667483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.667894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.668266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 852/1707] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:51.668390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] PATH_INFO: `/v3/projects/5d5d094556c643a1a151d8ed0a21fb09/users/b557885b1bd5450cba5b1f77d2d23175/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:51.669221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:51.678857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.715115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d094556c643a1a151d8ed0a21fb09, user_id=b557885b1bd5450cba5b1f77d2d23175, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:51.721155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:51.751516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 856/1708] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:51 2022] PUT /identity/v3/projects/5d5d094556c643a1a151d8ed0a21fb09/users/b557885b1bd5450cba5b1f77d2d23175/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:51.753462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:51.756907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:51.867426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea613c-4de2-4723-8cd1-576a96b38058 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.971298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef9bf-4983-4abd-b43d-b67f8fc0823b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:51.991721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:51.992863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:51.993413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:51.993884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.032392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:52.033069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:52.033335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:52.033606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.036408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:52.136502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:52.139689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:52.141840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cac4d-18b9-4493-abfe-6caf4d9f34a7 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:52.179559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 857/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:52.181084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446e43-f791-4bc4-bd24-6889e2eaa4c3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:52.181397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446e43-f791-4bc4-bd24-6889e2eaa4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:52.181674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446e43-f791-4bc4-bd24-6889e2eaa4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.221540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:52.224859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:52.244033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-90446e43-f791-4bc4-bd24-6889e2eaa4c3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:52.251396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-90446e43-f791-4bc4-bd24-6889e2eaa4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:52.268794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 853/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:52.274646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:52.368744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:52.469814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a78f-da5c-49ff-b4bc-ca2cfcd1b339 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:52.479683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:52.480610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:52.482630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:52.483177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.484283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:52.486647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:52.509877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 854/1711] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:52.510962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:52.521974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:52.570978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07f0c3-e2e2-495e-869f-0a17a248d6a6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:52.588078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:52.589058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:52.589537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:52.596659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] PATH_INFO: `/v3/projects/b129144da14e466fb754089da2dda444` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.601479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b129144da14e466fb754089da2dda444)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:52.603051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 858/1712] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:52.605314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:52.616230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:52.616534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:52.616847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:52.723879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] MFA Rules not processed for user `855568cbf9da4d3680a1f212fa9e4222`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:52.731603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:52.743137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b129144da14e466fb754089da2dda444', 'request_id': 'req-708cda7e-02e3-42d4-817b-9fafc706271e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:52.759448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b129144da14e466fb754089da2dda444', 'request_id': 'req-708cda7e-02e3-42d4-817b-9fafc706271e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:52.774962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b129144da14e466fb754089da2dda444', 'request_id': 'req-708cda7e-02e3-42d4-817b-9fafc706271e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:52.803526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] The token cache is being invalidate because project b129144da14e466fb754089da2dda444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:26:52.803827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:52.804736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:52.807592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 855/1713] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:26:52 2022] DELETE /identity/v3/projects/b129144da14e466fb754089da2dda444 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:52.813971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:52.818200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:52.943946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 859/1714] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:52.945020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:52.959178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:53.031640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cda7e-02e3-42d4-817b-9fafc706271e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:53.045926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:53.047275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.047729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.048158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] PATH_INFO: `/v3/projects/5d5d094556c643a1a151d8ed0a21fb09/users/b557885b1bd5450cba5b1f77d2d23175/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.053287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d094556c643a1a151d8ed0a21fb09, user_id=b557885b1bd5450cba5b1f77d2d23175, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:53.058226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864f95a-e17b-496f-87b6-e8176f931f99 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:53.086678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 856/1715] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:52 2022] PUT /identity/v3/projects/5d5d094556c643a1a151d8ed0a21fb09/users/b557885b1bd5450cba5b1f77d2d23175/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:53.088848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584cbf-77b8-454b-b382-994efc494b75 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.090570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584cbf-77b8-454b-b382-994efc494b75 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.090863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0584cbf-77b8-454b-b382-994efc494b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.136549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872421a-4eb8-4eec-bcc4-6bd032ae7c0d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:53.146120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e0584cbf-77b8-454b-b382-994efc494b75 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:53.147602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e0584cbf-77b8-454b-b382-994efc494b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:53.178388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:53.238649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:53.241004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:53.242485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.244212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.244867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.247568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:53.248419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:53.278329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:53.318194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 860/1716] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:53.319798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:53.322034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:53.350990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 857/1717] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:53.355021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.355313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.370288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.447188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] MFA Rules not processed for user `b557885b1bd5450cba5b1f77d2d23175`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:53.451735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:53.604605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326284-9264-4264-a4e9-db571804e3c0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:53.618638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:53.619320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.619607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.619885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.663005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 858/1718] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:53.664718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:53.703654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804af6-4c34-4c3a-aedc-ef37342a521f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:53.717932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:53.719735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.720019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.720291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.723324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:53.728702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe578d-e30e-449e-91b1-6f339acbd8df admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:53.811365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 859/1719] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:53.815473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:53.815783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:53.817318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:53.828789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:53.834997 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:53.909482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 861/1720] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:53.912630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:53.921636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:53.938671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:53.944003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:54.154753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb611d-4784-407f-b37e-b0742f1c5bf0 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.227270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:54.316606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 860/1721] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:54.320021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:54.322896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:54.324435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.324815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.325144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.332100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:54.382607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0afc-f554-4e7d-96cb-8f5fb30a43d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.408826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:54.408981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.416077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.417486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.418426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:54.437421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:54.539232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 861/1722] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:54 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:54.541018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:54.554924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:54.557494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:54.564012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590ca0c-d6cd-4049-a6b4-f3033fc05522 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.571454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:54.572168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.572466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.573540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.574447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:26:54.574762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:54.575962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 862/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:54.577064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bfa0a-2cd4-474a-9e67-3adf9dfb3dfb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:54.577882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:54.613668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63125-3194-4346-91a7-134d1379c866 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.623013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 862/1724] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:26:54.625187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.627341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:54.628108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.628404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.628902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.629260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.630064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.631850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:54.633856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:54.668183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 863/1725] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:54.668183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:54.682103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] MFA Rules not processed for user `789516a0875a4925b6dcf62550aabad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:54.682103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:54.711103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357a6e0-bbdc-4b66-a6a1-f76ad21a7533 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.715027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:54.746151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:54.750279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:54.754099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:54.756182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:54.758567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:54.777100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:54.834613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 863/1726] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:54.835907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:54.867965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b91e8b-e14b-4ecf-9e0c-360fe975c5dc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:54.871512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 864/1727] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:54 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:54.877951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.089022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.091415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.099812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.100370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.108708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.113033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f784-ce5a-453e-bc11-f66d6b6532a4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.162900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 864/1728] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:55.167311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.169822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.172913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.191449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b090-f044-4968-8718-de2744193701 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:55.213938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.215358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.216838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.217616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.218880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.224157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.231220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:55.233834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:55.274364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 865/1729] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:54 2022] POST /identity/v3/users => generated 294 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:55.275407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.303664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50c3f-e440-4705-824e-e99174777de3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:55.321652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.333540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.335234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.337322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] PATH_INFO: `/v3/projects/d139472e89264634aecb12ffaaaa9fd8/users/9a972e0c6d3b4b4c8df447eeedffbd34/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.373599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d139472e89264634aecb12ffaaaa9fd8, user_id=9a972e0c6d3b4b4c8df447eeedffbd34, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.377777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 865/1730] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:55.378803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.411059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471317f-38fc-4443-8ec9-272b48f32d7f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:55.424689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.425434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.425717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.426059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.427366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.428273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409d91c-acc2-4a00-90f0-af8d570cc4f4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.431592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.465094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 866/1731] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:55.468901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.484260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 866/1732] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:55 2022] PUT /identity/v3/projects/d139472e89264634aecb12ffaaaa9fd8/users/9a972e0c6d3b4b4c8df447eeedffbd34/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:55.497535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.497759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29ad91-39e9-4a51-b82e-3fdca0fc3d3c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:55.498699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.499089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.534651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:55.596424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] MFA Rules not processed for user `9a972e0c6d3b4b4c8df447eeedffbd34`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:55.604883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:55.715347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:55.759210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.759908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.760193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.762374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.763140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.767094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.815780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 867/1733] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:55.815780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.823422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:55.835883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 867/1734] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:55.835883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:55.868852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193388d-2115-4f0d-b076-cd25918dbbcd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:55.889093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:55.890238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:55.890461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:55.890738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] PATH_INFO: `/v3/projects/9de0b1b5983a4add82b273c6ef1d1fa1/users/7e9e6af855f64ca085776fea8652eddd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:55.930739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de0b1b5983a4add82b273c6ef1d1fa1, user_id=7e9e6af855f64ca085776fea8652eddd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:55.933451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:55.987066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 868/1735] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:55 2022] PUT /identity/v3/projects/9de0b1b5983a4add82b273c6ef1d1fa1/users/7e9e6af855f64ca085776fea8652eddd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:55.988541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:56.023758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bca4-0557-474e-9a1a-1746606cc727 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:56.170916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6ff9d-ac5e-4e67-813b-269121ebff27 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:56.185050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:56.196204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.199068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.199587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.200507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:56.203985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e83e40-3f0b-4050-89d5-0abb39e66927 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:56.244694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:56.245681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.247679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.247965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.305770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 869/1736] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:55 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:56.305770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.305770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.305770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.426357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:56.428378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:56.451253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] MFA Rules not processed for user `7e9e6af855f64ca085776fea8652eddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:56.452934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:56.484707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 868/1737] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:26:56.485868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:56.556824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580938-2d1f-4ae9-be10-b5fe923df257 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:56.656473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:56.689580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:56.784869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 870/1738] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:56.788667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:56.811682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:56.812399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.813696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.815893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.817589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:56.819893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:56.837015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3da9-aef5-4483-b791-86544f0636fa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:56.859460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:56.860633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.866240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.868389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.873402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:56.894558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 869/1739] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:56 2022] POST /identity/v3/users => generated 300 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:56.895023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:56.899151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:56.948317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b10-1531-453f-a564-39db8372e80b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:56.973425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:56.974413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:56.974698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:56.974972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:56.975957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:56.991435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:57.027017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 870/1740] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:57.033131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:57.056561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 871/1741] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:26:56 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:57.061312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:57.310454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88a227-8b81-4cb1-bcc1-b6b983d8898c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:57.310708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21036-84fc-427a-9474-45b2f6d079fb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:57.352540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:57.362891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.363208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.375859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] PATH_INFO: `/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e/users/c5bddebff98a4dbeb6a647e2ec2b2c86/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.490318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2273bc62b64a7eb0ede4f39ba79f4e, user_id=c5bddebff98a4dbeb6a647e2ec2b2c86, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:57.505724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:57.528353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:57.529025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.529315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.529569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.582019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 872/1742] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:57 2022] PUT /identity/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e/users/c5bddebff98a4dbeb6a647e2ec2b2c86/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:57.589647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:57.821985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d138a-27f7-430d-8aec-f65e1cfeac4f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:57.830415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:57.834076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19051146-08d1-4c8a-8b3a-cf889959d356 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:57.834410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:57.835104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.835392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.835669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.838152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:57.843412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1461-f092-4d11-9485-e9704f3ee641 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:57.871255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 871/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:57.875969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb74-958f-4133-bcfe-b075a2d57304 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.876501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb74-958f-4133-bcfe-b075a2d57304 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.877811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdabb74-958f-4133-bcfe-b075a2d57304 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.883032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 872/1744] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 15:26:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:26:57.884070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdabb74-958f-4133-bcfe-b075a2d57304 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:57.914097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdabb74-958f-4133-bcfe-b075a2d57304 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:57.929998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 873/1745] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:26:57 2022] POST /identity/v3/users => generated 300 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:26:57.931478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:57.932370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.932802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.932920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98376a7-df8a-4c9e-b7b7-01472cb53514 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:57.933101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98376a7-df8a-4c9e-b7b7-01472cb53514 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:57.933473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.934413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:57.935459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98376a7-df8a-4c9e-b7b7-01472cb53514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:57.936672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:57.958946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 873/1746] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:57.962224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:57.976313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:57.984219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222637b-91db-4ec7-a80e-cbfd25feb1e8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:58.003058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:58.003331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:58.003664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:58.004064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:58.004949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:58.006616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:58.018338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f98376a7-df8a-4c9e-b7b7-01472cb53514 None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:58.020901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f98376a7-df8a-4c9e-b7b7-01472cb53514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:58.052683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 874/1747] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:26:58.052683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:58.091490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5b0d1-462e-4b4f-a37e-d215c6ac915d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:58.114472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:58.115387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:58.115663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:58.115938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] PATH_INFO: `/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e/users/c5bddebff98a4dbeb6a647e2ec2b2c86/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:58.132928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2273bc62b64a7eb0ede4f39ba79f4e, user_id=c5bddebff98a4dbeb6a647e2ec2b2c86, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:58.147019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:58.149519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:58.214217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 875/1748] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:58 2022] PUT /identity/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e/users/c5bddebff98a4dbeb6a647e2ec2b2c86/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:58.215397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:58.255870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 874/1749] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:26:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:58.259352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:58.259678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:58.259930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:58.343534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] MFA Rules not processed for user `c5bddebff98a4dbeb6a647e2ec2b2c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:58.345767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:58.470397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585be7-f9a3-4522-a011-5af2ee510412 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:58.492142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:58.493473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:58.496500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:58.496978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] PATH_INFO: `/v3/projects/5f1aa491557c4f00a9137a1ce464baf7/users/ed3d3aead60e4546842b652c8931ea35/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:58.543034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1aa491557c4f00a9137a1ce464baf7, user_id=ed3d3aead60e4546842b652c8931ea35, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:58.548020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:58.582635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 876/1750] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:58 2022] PUT /identity/v3/projects/5f1aa491557c4f00a9137a1ce464baf7/users/ed3d3aead60e4546842b652c8931ea35/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:58.586807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:58.642224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 875/1751] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:26:58.654041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:58.656061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:58.801107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da6dc-4d51-4440-8801-1858bdcbc491 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:58.823316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:58.827754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:58.828094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:58.828388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:58.831355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:58.834097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:58.855579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92d7e1-ec11-469f-b98f-29bd49abc2ff None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:58.863912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 877/1752] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:26:58.865613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:58.873447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:58.994665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267b231-15d0-4f4a-bad7-26973cbb783d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:59.005888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.009334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.013233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.013781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.022813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.027080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.027951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.028549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.041809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.046548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.066354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 878/1753] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:59.074974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:59.089833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:59.107924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa25ec3-22c7-4ab2-a9f7-9c1a1cf5f55c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:59.123616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.126136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.126436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.126732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] PATH_INFO: `/v3/projects/5f1aa491557c4f00a9137a1ce464baf7/users/ed3d3aead60e4546842b652c8931ea35/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.131321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1aa491557c4f00a9137a1ce464baf7, user_id=ed3d3aead60e4546842b652c8931ea35, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.142052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d34079-b79e-47f4-a690-805b7de911e4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.154477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:26:59.187645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 879/1754] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:26:59 2022] PUT /identity/v3/projects/5f1aa491557c4f00a9137a1ce464baf7/users/ed3d3aead60e4546842b652c8931ea35/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:59.190373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b661-271e-46aa-8259-6f633d684809 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.191032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b661-271e-46aa-8259-6f633d684809 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.191349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b661-271e-46aa-8259-6f633d684809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.221942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.223535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.254687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 876/1755] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:26:59.259169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c266b661-271e-46aa-8259-6f633d684809 None None] MFA Rules not processed for user `ed3d3aead60e4546842b652c8931ea35`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:26:59.260392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c266b661-271e-46aa-8259-6f633d684809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:26:59.330975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:59.355235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627f3c2-7d6a-4e20-a2b8-9cd7b6aef4b4 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:59.385580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 880/1756] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:26:59.398488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b661-271e-46aa-8259-6f633d684809 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:59.514308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.515092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.515379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.516358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] PATH_INFO: `/v3/users/9a972e0c6d3b4b4c8df447eeedffbd34` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.521076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a972e0c6d3b4b4c8df447eeedffbd34)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.523295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.545779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b661-271e-46aa-8259-6f633d684809 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:59.553269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.555581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.556020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.556494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.591540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.594082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.609482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 881/1757] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:26:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:26:59.745877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a972e0c6d3b4b4c8df447eeedffbd34'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.747682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a972e0c6d3b4b4c8df447eeedffbd34'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.748414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a972e0c6d3b4b4c8df447eeedffbd34'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.768677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:26:59.801484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ef724-ec2a-4551-9c6b-5d9cf9de716c service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:26:59.808386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a972e0c6d3b4b4c8df447eeedffbd34'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.812063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:26:59.813269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.814857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.816246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] PATH_INFO: `/v3/users/7e9e6af855f64ca085776fea8652eddd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.820175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9e6af855f64ca085776fea8652eddd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:26:59.824389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:26:59.841880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-38438da7-64a8-463c-8936-9dae23e5fd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a972e0c6d3b4b4c8df447eeedffbd34'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.921674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 877/1758] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:59 2022] DELETE /identity/v3/users/9a972e0c6d3b4b4c8df447eeedffbd34 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:26:59.927906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:26:59.929139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:26:59.929776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:26:59.934803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9e6af855f64ca085776fea8652eddd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.937858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9e6af855f64ca085776fea8652eddd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.938736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9e6af855f64ca085776fea8652eddd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.956325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9e6af855f64ca085776fea8652eddd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.977610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b3293e7-a59a-4269-9e56-e51f5c0f7886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9e6af855f64ca085776fea8652eddd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:26:59.995953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:00.059330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 882/1759] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:26:59 2022] DELETE /identity/v3/users/7e9e6af855f64ca085776fea8652eddd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:00.063503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:00.063856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:00.064029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:00.109265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:00.116846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:00.145248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:00.146502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:00.322306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:00.365207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 878/1760] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:00.435439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 883/1761] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:00.501812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:00.504073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:00.514894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:00.516701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:00.760623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ef4bf-89b1-4bf2-9670-8c2a072b521f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:00.764727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021c48b-e436-4d02-ad31-f0209716437e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:00.775191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:00.775871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:00.776185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:00.776463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:00.777794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:00.778765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:00.778765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:00.779204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:00.819323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:00.823656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:00.826407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0156f-1576-4ced-86cd-db1ea59fadc9 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:00.837052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8902a5f-9410-48c8-b3db-41daca8a5cf5 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:00.888418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 879/1762] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:00.888662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 884/1763] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:01.004764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a61e-523d-4043-946d-cc6997c4adf9 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:01.005058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a61e-523d-4043-946d-cc6997c4adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:01.005344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a61e-523d-4043-946d-cc6997c4adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:01.048889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f860a61e-523d-4043-946d-cc6997c4adf9 None None] MFA Rules not processed for user `855568cbf9da4d3680a1f212fa9e4222`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:01.050730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f860a61e-523d-4043-946d-cc6997c4adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:01.147391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:01.148024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:01.148024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:01.205980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] MFA Rules not processed for user `d79e251952bb4791a04ce88e90c11dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:01.207337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:01.331125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 880/1764] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:01.434428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 885/1765] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:01.892617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:01.893503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:01.894651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:01.938093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:01.943061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:01.993505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 881/1766] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jul 6 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:02.132950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:02.134454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:02.173031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bef376-ab86-41cf-9548-cef84a6d6ee0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:02.209839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:02.210559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:02.210871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:02.211111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:02.246489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:02.252218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:02.277402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 886/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:03.423841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:03.427718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:03.491980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547f3a-db5e-4d7d-9930-77372a1910a8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:03.495324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:03.500965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:03.506875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:03.510494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:03.511660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:03.513037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] PATH_INFO: `/v3/users/e425186356c641f7a04014ad86ae4fa0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:03.517774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e425186356c641f7a04014ad86ae4fa0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:03.529615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:03.560968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe593a-1fd4-440f-b019-9682c4e86087 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:03.595546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:03.603316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:03.603830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:03.604265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] PATH_INFO: `/v3/projects/9de0b1b5983a4add82b273c6ef1d1fa1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:03.607187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de0b1b5983a4add82b273c6ef1d1fa1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:03.609326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:03.697915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:03.741605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e425186356c641f7a04014ad86ae4fa0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.757030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e425186356c641f7a04014ad86ae4fa0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.759868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e425186356c641f7a04014ad86ae4fa0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.769654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de0b1b5983a4add82b273c6ef1d1fa1', 'request_id': 'req-063d034d-090c-4131-bd3b-58c77bdc59ca'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.782785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de0b1b5983a4add82b273c6ef1d1fa1', 'request_id': 'req-063d034d-090c-4131-bd3b-58c77bdc59ca'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.799084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de0b1b5983a4add82b273c6ef1d1fa1', 'request_id': 'req-063d034d-090c-4131-bd3b-58c77bdc59ca'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.814351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e425186356c641f7a04014ad86ae4fa0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.840233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] The token cache is being invalidate because project 9de0b1b5983a4add82b273c6ef1d1fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:03.840887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.845981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.848787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e425186356c641f7a04014ad86ae4fa0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:03.853990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 887/1768] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:03 2022] DELETE /identity/v3/projects/9de0b1b5983a4add82b273c6ef1d1fa1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:03.855173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:03.858397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:03.890654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 882/1769] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:03 2022] DELETE /identity/v3/users/e425186356c641f7a04014ad86ae4fa0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:03.891849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:03.897530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:03.949538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:04.142182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d034d-090c-4131-bd3b-58c77bdc59ca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:04.144920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488525c-a4e5-40fb-9bc3-08907a058693 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:04.176861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:04.177825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:04.179054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:04.180228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:04.182110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] PATH_INFO: `/v3/projects/d139472e89264634aecb12ffaaaa9fd8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:04.187852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d139472e89264634aecb12ffaaaa9fd8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:04.194130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:04.197064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:04.202006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:04.202352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] PATH_INFO: `/v3/users/ed3d3aead60e4546842b652c8931ea35` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:04.224185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3d3aead60e4546842b652c8931ea35)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:04.228898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:04.399603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3d3aead60e4546842b652c8931ea35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.403875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3d3aead60e4546842b652c8931ea35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.407608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3d3aead60e4546842b652c8931ea35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.411290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd139472e89264634aecb12ffaaaa9fd8', 'request_id': 'req-91d65441-baea-4ff4-af5f-156f655d6384'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.419982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd139472e89264634aecb12ffaaaa9fd8', 'request_id': 'req-91d65441-baea-4ff4-af5f-156f655d6384'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.434418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd139472e89264634aecb12ffaaaa9fd8', 'request_id': 'req-91d65441-baea-4ff4-af5f-156f655d6384'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.453761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] The token cache is being invalidate because project d139472e89264634aecb12ffaaaa9fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:04.456027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3d3aead60e4546842b652c8931ea35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.456829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.461395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91d65441-baea-4ff4-af5f-156f655d6384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.463364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 888/1770] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:03 2022] DELETE /identity/v3/projects/d139472e89264634aecb12ffaaaa9fd8 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:04.464906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:04.465318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:04.465700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:04.486962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3d3aead60e4546842b652c8931ea35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:04.540848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 883/1771] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:03 2022] DELETE /identity/v3/users/ed3d3aead60e4546842b652c8931ea35 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:04.545171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:04.546384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:04.550933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:04.554877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:04.684766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:04.800575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 889/1772] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:04.828756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032217f4-5db4-4a6f-bfac-aeff6fb53443 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:04.842016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:04.843472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:04.844022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:04.844654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] PATH_INFO: `/v3/users/c5bddebff98a4dbeb6a647e2ec2b2c86` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:04.853522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5bddebff98a4dbeb6a647e2ec2b2c86)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:04.860559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:04.957375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:05.000413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5bddebff98a4dbeb6a647e2ec2b2c86'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:05.006686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5bddebff98a4dbeb6a647e2ec2b2c86'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:05.008915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5bddebff98a4dbeb6a647e2ec2b2c86'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:05.047017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:05.048505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:05.054067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5bddebff98a4dbeb6a647e2ec2b2c86'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:05.068666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5bddebff98a4dbeb6a647e2ec2b2c86'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:05.093945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 884/1773] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:04 2022] DELETE /identity/v3/users/c5bddebff98a4dbeb6a647e2ec2b2c86 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:05.335374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece013a-1dea-4f29-9d23-44cc22acf057 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:05.545997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:05.546671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:05.547258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:05.547258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:05.549344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:05.950876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:05.952350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365dae3-77df-44ac-88bd-059efea0f1e6 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:06.004427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 890/1774] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 958 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:07.016466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:07.017999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:07.062900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634973c-8ab5-4a43-897a-f53a6081f5c5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:07.084705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:07.087823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.103295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.103295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] PATH_INFO: `/v3/projects/5f1aa491557c4f00a9137a1ce464baf7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.104229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1aa491557c4f00a9137a1ce464baf7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:07.106573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:07.265796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1aa491557c4f00a9137a1ce464baf7', 'request_id': 'req-bbae139a-017e-400b-8204-9fd669e4389b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:07.310586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1aa491557c4f00a9137a1ce464baf7', 'request_id': 'req-bbae139a-017e-400b-8204-9fd669e4389b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:07.332037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1aa491557c4f00a9137a1ce464baf7', 'request_id': 'req-bbae139a-017e-400b-8204-9fd669e4389b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:07.368226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] The token cache is being invalidate because project 5f1aa491557c4f00a9137a1ce464baf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:07.368748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:07.369545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bbae139a-017e-400b-8204-9fd669e4389b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:07.386269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 885/1775] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:07 2022] DELETE /identity/v3/projects/5f1aa491557c4f00a9137a1ce464baf7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:07.387357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.388210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.388644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.443620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:07.443620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:07.679417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:07.811521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 891/1776] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:07.818990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.819272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.819579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.873629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:07.876538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:07.877057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:07.879815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:07.888965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 886/1777] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:07.893105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:07.905664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6e86-443d-4d01-a525-c2034d56790b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:07.909568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb05a1a-18b4-40cc-ac43-19e33cfd6a4b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:07.911150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:07.911831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.912117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.912476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.913169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:07.913478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:07.915358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:07.939307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 887/1778] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:07.940206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:07.951062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477edf-fd3f-4316-a2a2-ef06992225a6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:07.955960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:07.957139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.957462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.957740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.958479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:07.959543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:07.960581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:07.964823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:07.965857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:07.967003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] PATH_INFO: `/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:07.972801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2273bc62b64a7eb0ede4f39ba79f4e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:07.987064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:08.015500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 888/1779] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:07 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:08.016808 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:08.179347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2273bc62b64a7eb0ede4f39ba79f4e', 'request_id': 'req-3e59cc57-2f60-450e-a12b-07a1cbcffdee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:08.181582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:08.214766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca026a-c02c-4a0c-991a-d01a5230e136 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:08.224752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2273bc62b64a7eb0ede4f39ba79f4e', 'request_id': 'req-3e59cc57-2f60-450e-a12b-07a1cbcffdee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:08.279476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2273bc62b64a7eb0ede4f39ba79f4e', 'request_id': 'req-3e59cc57-2f60-450e-a12b-07a1cbcffdee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:08.375709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] The token cache is being invalidate because project 4b2273bc62b64a7eb0ede4f39ba79f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:08.379783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:08.384633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3e59cc57-2f60-450e-a12b-07a1cbcffdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:08.393398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 892/1780] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:07 2022] DELETE /identity/v3/projects/4b2273bc62b64a7eb0ede4f39ba79f4e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:08.398926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67bd8-9c79-44c9-b256-e06b00ec151f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:08.401515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67bd8-9c79-44c9-b256-e06b00ec151f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:08.402002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67bd8-9c79-44c9-b256-e06b00ec151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:08.495187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-75d67bd8-9c79-44c9-b256-e06b00ec151f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:08.498871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-75d67bd8-9c79-44c9-b256-e06b00ec151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:08.560999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:08.561852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:08.562165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:08.562438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:08.563319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:08.574501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:08.661813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 889/1781] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:08 2022] POST /identity/v3/users => generated 284 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:08.678069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:08.686324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:08.746044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1515-965b-4d0a-8c7c-19e4f62499d6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:08.779064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:08.781095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:08.783034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:08.784267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:08.787693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:08.805726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 893/1782] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:08.808053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:08.814175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:08.819790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:08.820339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:08.932789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 890/1783] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:08.934139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.018344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:09.027653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573340dc-b765-4200-b0bc-a1e8f85bc173 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.032129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:09.084056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 894/1784] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:09.090574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.106955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:09.113067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.117925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.122384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.127893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:09.135970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:09.158582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 891/1785] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:09.164384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.182091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57f45-e6e5-477f-846f-916d0254ea59 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.225934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:09.226623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.226903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.227176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.227918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:09.240837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228f4f-9caf-4468-bd86-0680de3106d6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.252626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:09.262753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:09.286565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:09.294148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.295772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.302433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] PATH_INFO: `/v3/projects/b0d7ac0c62d24a23a70d8ce9b0e052cb/users/51cdb17aa77649c5aac662e322a34f87/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.329077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d7ac0c62d24a23a70d8ce9b0e052cb, user_id=51cdb17aa77649c5aac662e322a34f87, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:09.333581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e6f44-3bf2-4eb5-8176-cfcef98687d0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:09.365112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 895/1786] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:09.367760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.380669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 892/1787] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:09 2022] PUT /identity/v3/projects/b0d7ac0c62d24a23a70d8ce9b0e052cb/users/51cdb17aa77649c5aac662e322a34f87/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:09.393464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b607-007b-47b8-8461-f62bbae6e71b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.394633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b607-007b-47b8-8461-f62bbae6e71b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.394872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b607-007b-47b8-8461-f62bbae6e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.405393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b3ce2-8b4f-477c-adbb-e4a762e01d18 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.432167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0821b607-007b-47b8-8461-f62bbae6e71b None None] MFA Rules not processed for user `51cdb17aa77649c5aac662e322a34f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:09.433858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0821b607-007b-47b8-8461-f62bbae6e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:09.553725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 893/1788] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:09.557106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00ccd-ea07-45a9-acf7-655dbb345d9c None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.557726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00ccd-ea07-45a9-acf7-655dbb345d9c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.558427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca00ccd-ea07-45a9-acf7-655dbb345d9c None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.560339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 894/1789] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:27:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:27:09.561234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00ccd-ea07-45a9-acf7-655dbb345d9c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.577725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:09.630487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:09.638998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:09.641469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.641782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.642117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.647333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:09.649338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de820ad-f76f-4f2e-b54e-f9df38cebce8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:09.715118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca00ccd-ea07-45a9-acf7-655dbb345d9c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.727694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:09.728769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.729316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.729767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.732791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:09.738417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:09.750787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 896/1790] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:09 2022] POST /identity/v3/projects => generated 385 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:09.752339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e4c88-7061-462c-971d-987354151428 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:09.752658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e4c88-7061-462c-971d-987354151428 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:09.752923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e4c88-7061-462c-971d-987354151428 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:09.760545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 897/1791] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:27:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:27:09.761383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e4c88-7061-462c-971d-987354151428 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.809015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 895/1792] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:09 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:09.809832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:09.952536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e4c88-7061-462c-971d-987354151428 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:09.992460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbd49-30b2-4b92-8de0-4c47b44a896b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.008741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.009536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.010404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.010684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.013893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.021919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382e87-3729-496f-bfc2-6c64539b1b9e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.072229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 896/1793] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:09 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:10.077001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.078202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.078846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.134438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.135746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.136572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.138000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:10.138444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.139803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.146754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:10.149500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8961ba-3992-490c-b3e3-ce7b307c283e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.277607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 898/1794] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:09 2022] POST /identity/v3/users => generated 293 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:10.279180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.279569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.279731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.328753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:10.330048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:10.387201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 897/1795] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:10.388192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.412466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f25bb-5e1b-40b1-b6c2-fe12272decc2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.422763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.423469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.426262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.427646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.428530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.436550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.472074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 898/1796] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:10.477203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.513617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bae3e-76cf-4969-b2f1-7e06d890ca5f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.526543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 899/1797] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:10.527924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.531878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.535266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.539062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.539477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.541236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.546314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.551194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:10.565159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5208ee-eff7-4a37-bf30-f9b6f340ad34 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.607713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.607713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.607943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 899/1798] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:10.607943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.610858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.611228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] PATH_INFO: `/v3/projects/d9dce372bbf7425f819425db7e334199/users/ac5197aa8133454da263e70a68413aa6/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.640792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c692c-3066-4e61-b2d4-db38c8230476 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.662668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:10.665215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:10.667816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:10.668933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:10.669781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.680536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dce372bbf7425f819425db7e334199, user_id=ac5197aa8133454da263e70a68413aa6, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:10.681004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.690968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:10.748009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 900/1799] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:10 2022] PUT /identity/v3/projects/d9dce372bbf7425f819425db7e334199/users/ac5197aa8133454da263e70a68413aa6/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:10.749773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.774399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 900/1800] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:10.776249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:10.814784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:10.835427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e72f-1a41-4588-8a7b-03fff48d7bb4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:10.999850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.005630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.006415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.007537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] PATH_INFO: `/v3/projects/735a4eb530ba4cefb7b0d0177d0eb2d5/users/c0f1f9b72f3f477e94dcacd5e09030d6/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.009302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466f6d-5271-46d8-b40c-603cd652bb27 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.042314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735a4eb530ba4cefb7b0d0177d0eb2d5, user_id=c0f1f9b72f3f477e94dcacd5e09030d6, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.045056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.052017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.052650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.053034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.053287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.054197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.055842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.077553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 901/1801] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:11.078449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:11.095524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:11.105366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 901/1802] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:10 2022] PUT /identity/v3/projects/735a4eb530ba4cefb7b0d0177d0eb2d5/users/c0f1f9b72f3f477e94dcacd5e09030d6/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:11.121750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:11.316196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dca71b-8c57-4628-880a-63077f43281b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.355497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a034-06b7-4069-9246-0c70292ea930 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.368364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.370813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.372346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.373349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] PATH_INFO: `/v3/projects/d9dce372bbf7425f819425db7e334199/users/ac5197aa8133454da263e70a68413aa6/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.380110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dce372bbf7425f819425db7e334199, user_id=ac5197aa8133454da263e70a68413aa6, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.386280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833222e-9114-4475-8bf9-40f92f764378 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.422562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 902/1803] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:11 2022] PUT /identity/v3/projects/d9dce372bbf7425f819425db7e334199/users/ac5197aa8133454da263e70a68413aa6/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:11.426748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.426936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.427220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.485404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] MFA Rules not processed for user `c0f1f9b72f3f477e94dcacd5e09030d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:11.487656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:11.528550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.529230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.529525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.529805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.560296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.563088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1e72d-3ed2-48ee-8877-8064bf2a4c13 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.569563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:11.576802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 902/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:11.578310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.579035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.579333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.621768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] MFA Rules not processed for user `ac5197aa8133454da263e70a68413aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:11.626793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:11.647611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 903/1805] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:11.655119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:11.668612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:11.705247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:11.732217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 903/1806] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:11.733154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:11.735113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:11.866750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1b26-db9f-4a7b-9051-231e4f16be25 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.874293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d6b4f-2279-461b-b6ce-487c60f88f1f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.881078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.882170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.883164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.883984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.884518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.885736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.886052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.886327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] PATH_INFO: `/v3/projects/42717d3de4e14f4e8df8fbb7c8f691ff` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.889037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42717d3de4e14f4e8df8fbb7c8f691ff)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.891103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.901069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.903898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.922796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 904/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:11.924061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:11.941154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c8320-810d-4cbf-ba50-bb6b1bca9f53 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:11.947781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:11.948854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:11.949384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:11.949866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:11.951288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:11.953649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:11.994972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42717d3de4e14f4e8df8fbb7c8f691ff', 'request_id': 'req-ca31af38-ec16-4ed4-9ec9-05f2df950606'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.003104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 905/1808] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:11 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:12.004702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.006761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.014918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42717d3de4e14f4e8df8fbb7c8f691ff', 'request_id': 'req-ca31af38-ec16-4ed4-9ec9-05f2df950606'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.031741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42717d3de4e14f4e8df8fbb7c8f691ff', 'request_id': 'req-ca31af38-ec16-4ed4-9ec9-05f2df950606'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.063188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] The token cache is being invalidate because project 42717d3de4e14f4e8df8fbb7c8f691ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:12.063780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.064729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.066840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 904/1809] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:11 2022] DELETE /identity/v3/projects/42717d3de4e14f4e8df8fbb7c8f691ff => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:12.072721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.075867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.114621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:12.158254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc321f8-f17f-4793-835a-99c4b07c2134 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.165761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.166462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.166745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.167020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.176084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.214891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31af38-ec16-4ed4-9ec9-05f2df950606 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.263535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.266701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.280036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 906/1810] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:12.281114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.293082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.355774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:12.375373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.377615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.379267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.380480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.382164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.384793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.417433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 905/1811] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:12 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:12.419332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.421646 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.436036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ba083-7a5b-43fc-bb0b-37a9b90ccfa7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.441735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.442727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.443097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.443924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.453810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.469965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e304-9b5e-4823-a7a0-d2578ca4c02b service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.477302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.478298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.478655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.479036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] PATH_INFO: `/v3/users/b557885b1bd5450cba5b1f77d2d23175` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.480712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b557885b1bd5450cba5b1f77d2d23175)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.484103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.583971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.589258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b557885b1bd5450cba5b1f77d2d23175'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.589676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.590528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b557885b1bd5450cba5b1f77d2d23175'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.591426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b557885b1bd5450cba5b1f77d2d23175'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.609723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 906/1812] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:12.610700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.625742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b557885b1bd5450cba5b1f77d2d23175'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.641558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b557885b1bd5450cba5b1f77d2d23175'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:12.649284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be2b-3510-4b97-9ba1-7d396c72e33b service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.656856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.657590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.658100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.658547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.660370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.666252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.676078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 907/1813] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:12 2022] DELETE /identity/v3/users/b557885b1bd5450cba5b1f77d2d23175 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:12.680996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 907/1814] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:12.684886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.686521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:12.851579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2cfa-0705-47f3-a633-9ec476d7555b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.866129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.866878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.867141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.870118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:12.873858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:12.879884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8a56-841b-488c-b5cd-cf6a3bd74b9d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:12.914970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:12.915814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 908/1815] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:12.929994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc68fdd-3376-4c17-8fd4-bab7712428d2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:12.944313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:12.945277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:12.945489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:12.947118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] PATH_INFO: `/v3/projects/7f6da457e7cd4070ace166cce0c2f883/users/163238a64b554bcb8cbfdaed758ab94a/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.019148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6da457e7cd4070ace166cce0c2f883, user_id=163238a64b554bcb8cbfdaed758ab94a, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.021831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.067177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 908/1816] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:12 2022] PUT /identity/v3/projects/7f6da457e7cd4070ace166cce0c2f883/users/163238a64b554bcb8cbfdaed758ab94a/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:13.070061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019274c-1b76-408c-bc37-920203331886 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.070695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019274c-1b76-408c-bc37-920203331886 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.071173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019274c-1b76-408c-bc37-920203331886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.125882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2019274c-1b76-408c-bc37-920203331886 None None] MFA Rules not processed for user `163238a64b554bcb8cbfdaed758ab94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:13.127153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2019274c-1b76-408c-bc37-920203331886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.195107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:13.294961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.297360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.305157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 909/1817] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:13.312733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019274c-1b76-408c-bc37-920203331886 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.322062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:13.390906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ccf9-caf8-455c-9a5b-b19debb47d46 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.396513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:13.397610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.398092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.398479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] PATH_INFO: `/v3/users/e9bbce269d5e4119ab44495ed4752859` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.401410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bbce269d5e4119ab44495ed4752859)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.404173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.485307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bbce269d5e4119ab44495ed4752859'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.485814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019274c-1b76-408c-bc37-920203331886 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.486249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bbce269d5e4119ab44495ed4752859'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.487462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bbce269d5e4119ab44495ed4752859'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.494182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:13.494964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.495402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.495713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.496438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.498492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.501152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bbce269d5e4119ab44495ed4752859'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.514087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-191fe441-c8c2-4675-826b-64b6b787a485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bbce269d5e4119ab44495ed4752859'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.543556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 910/1818] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:13 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:13.546800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.549098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.553528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 909/1819] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:13 2022] DELETE /identity/v3/users/e9bbce269d5e4119ab44495ed4752859 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:13.557963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.558600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.558894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.585137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:13.586428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.700674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6185a95-4651-4e0a-95ba-9b3d3488fdda admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.709892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:13.710746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.711642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.712039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.712903 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.716020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 910/1820] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:13.716020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.716020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.739129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.743987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67f415-40fa-4129-895c-50dbeae2192a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.751204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:13.752642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.752642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.753439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] PATH_INFO: `/v3/projects/5d5d094556c643a1a151d8ed0a21fb09` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.755252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5d094556c643a1a151d8ed0a21fb09)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.757325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.790107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 911/1821] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:13 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:13.793676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.796800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:13.798911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.821143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5d094556c643a1a151d8ed0a21fb09', 'request_id': 'req-eff06f29-a6fb-4881-94f4-05f4c63a613d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.827250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5d094556c643a1a151d8ed0a21fb09', 'request_id': 'req-eff06f29-a6fb-4881-94f4-05f4c63a613d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.835444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5d094556c643a1a151d8ed0a21fb09', 'request_id': 'req-eff06f29-a6fb-4881-94f4-05f4c63a613d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.865446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] The token cache is being invalidate because project 5d5d094556c643a1a151d8ed0a21fb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:13.865734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.866705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:13.873836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 911/1822] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:13 2022] DELETE /identity/v3/projects/5d5d094556c643a1a151d8ed0a21fb09 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:13.873836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:13.877289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:13.918448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:13.936477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af189af-71a4-45ea-8adb-147752e82df4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.970272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06f29-a6fb-4881-94f4-05f4c63a613d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:13.975519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:13.976196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.976478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.976756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:13.977491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:13.979265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5390af9-ecd2-4c1d-803a-6c4ac2aa5fbe admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:13.992134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 912/1823] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:13.993426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:13.993717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:13.994029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.002720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.004026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.004372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.004718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.006666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:14.016835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:14.018069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:14.019763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.021493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac8aef-2180-44bb-8c40-1f65e726163c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.027224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 913/1824] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:14.027976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.038159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098c89a-55f3-428f-9cad-aaac0f9f1eb3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.042339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 912/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:14.043397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.043968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.044258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.044525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.045302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.045926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.046629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] PATH_INFO: `/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9/users/bd9cc206cea04605adf8687d823499ec/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.066503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:14.067709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:14.071674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcafb90f0a2a4a35add0a27a337da2f9, user_id=bd9cc206cea04605adf8687d823499ec, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.075675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.079059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 913/1826] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:14.083500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.097875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca9e9-8013-4645-b583-c273adce66e3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.099653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 914/1827] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:14 2022] PUT /identity/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9/users/bd9cc206cea04605adf8687d823499ec/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:14.103699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.175910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.176500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.176854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.177412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.178588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:14.178938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.180954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.199309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9896-2344-46c0-ad0c-9869b2531284 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.202030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 914/1828] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:14.202942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.206681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.207606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.207955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.208297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.209262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.211062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.213434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa186ac-d4fc-4fe6-adcc-245ae1e1e9e5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.219060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.219725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.220296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.220579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.221274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.223395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922db2-ed80-403f-8410-a61e5684ae1f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.231209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 915/1829] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:14.232401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.245632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211768e-0a66-4bf1-bb13-073d3eb48b0e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.253881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.255037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.255372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.255718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] PATH_INFO: `/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9/users/bd9cc206cea04605adf8687d823499ec/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.257981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcafb90f0a2a4a35add0a27a337da2f9, user_id=bd9cc206cea04605adf8687d823499ec, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.262186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.294586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 916/1830] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:14 2022] PUT /identity/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9/users/bd9cc206cea04605adf8687d823499ec/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:14.297983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 915/1831] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:14 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:14.297983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.297983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.297983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.300836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.326743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:14.344058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] MFA Rules not processed for user `bd9cc206cea04605adf8687d823499ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:14.347549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:14.449215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec30cd-5bb4-4192-b20c-f2e7e602c59a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.470586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:14.494075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 916/1832] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:14.506564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.508142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:14.558333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.559778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.560168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.560545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.561351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.563559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.604724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 917/1833] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:14 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:14.610943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.645045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da7c9b-ed0f-45b6-9338-f08a9ba6596f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.649746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea16c-c806-42b9-9309-f00a2237119c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.661075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.661759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.662086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.662352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.685272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.686603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.686764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.687844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.689535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.689842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.694657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.702317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.713567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 917/1834] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:14.743822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.745880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 918/1835] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:14.757580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668ae46-966f-418d-90c6-9bcfeae9519d service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.778946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.779839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.780271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.780692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.781580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.783411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e748a8-5f89-4b12-a491-7c4083395033 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.813145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 918/1836] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:14.817852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:14.841634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1b1f-dbb7-4767-ba89-611cc30cecc3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:14.867137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:14.868369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.868632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.868835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] PATH_INFO: `/v3/projects/f071d35ec7d34784b62b5fc1d3a62fcd/users/c1e897c526b340e7a37e702b6d7b3908/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:14.908847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f071d35ec7d34784b62b5fc1d3a62fcd, user_id=c1e897c526b340e7a37e702b6d7b3908, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:14.911645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:14.961388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 919/1837] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:14 2022] PUT /identity/v3/projects/f071d35ec7d34784b62b5fc1d3a62fcd/users/c1e897c526b340e7a37e702b6d7b3908/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:14.964646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:14.965801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:14.967185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.058318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] MFA Rules not processed for user `c1e897c526b340e7a37e702b6d7b3908`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:15.058318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:15.170028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 919/1838] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:15.171351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.258997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd728-f146-4a6f-8f1f-5ae79934f7cf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.269035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.269716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.270031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.270475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.271332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.273431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.286244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:15.318113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 920/1839] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:15 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:15.321876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.339103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c2719-a209-479b-addf-c14fcac08ccd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.447408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.448221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.448572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.448844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.449578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.451845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.504268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 920/1840] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:15 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:15.505476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.525401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c346d4-d50f-4f9e-99d1-b2bc580f4776 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.542208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.542861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.543148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.543425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.544175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.546795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.569310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 921/1841] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:15.572165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.586077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:15.591987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ae0ae-a93c-44ab-bc84-37c4f749b6e7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.600898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.602015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.602367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.602613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] PATH_INFO: `/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa/users/d200eb2fbdf844e2aa7b9f14a6fbde65/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.631719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.635662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:15.666664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2a94acd53146bcb9fb1a1e83d6c2fa, user_id=d200eb2fbdf844e2aa7b9f14a6fbde65, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.668465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451bb1f-2251-4d64-b46f-7b476dff26b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.676230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.677384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.678386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.678994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] PATH_INFO: `/v3/projects/00d04f323e124d9ea251f48457416ab2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.680616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d04f323e124d9ea251f48457416ab2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.683402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.703878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.729873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 921/1842] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:15 2022] PUT /identity/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa/users/d200eb2fbdf844e2aa7b9f14a6fbde65/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:15.735965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.768357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d04f323e124d9ea251f48457416ab2', 'request_id': 'req-1f4a3257-1f76-456b-9fee-362f6a3fc125'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:15.776500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d04f323e124d9ea251f48457416ab2', 'request_id': 'req-1f4a3257-1f76-456b-9fee-362f6a3fc125'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:15.787352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d04f323e124d9ea251f48457416ab2', 'request_id': 'req-1f4a3257-1f76-456b-9fee-362f6a3fc125'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:15.812728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] The token cache is being invalidate because project 00d04f323e124d9ea251f48457416ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:15.813066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:15.815872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:15.818217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 922/1843] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:15 2022] DELETE /identity/v3/projects/00d04f323e124d9ea251f48457416ab2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:15.819722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.822309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:15.829646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138917a9-5aac-4242-b0a0-036b92f87cb0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.892602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.893572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.894051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.894533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.896678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:15.900561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a3257-1f76-456b-9fee-362f6a3fc125 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.907685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.908614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.909543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.909939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.910816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.912562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.924025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 923/1844] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:15.929095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:15.930958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:15.944538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f7ea-8f9c-44a0-bdef-8486bf9c737e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:15.950320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:15.951236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:15.951717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:15.952053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] PATH_INFO: `/v3/users/939f2e9846154e1bb2bfd8f82b919c8d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:15.953399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=939f2e9846154e1bb2bfd8f82b919c8d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.955570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.969021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:15.971246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:15.989092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 922/1845] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:15.989929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:16.003130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcddc1-dd24-4207-a410-ded09517f71e service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:16.011173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:16.012609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:16.013086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:16.013556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] PATH_INFO: `/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa/users/d200eb2fbdf844e2aa7b9f14a6fbde65/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:16.016408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2a94acd53146bcb9fb1a1e83d6c2fa, user_id=d200eb2fbdf844e2aa7b9f14a6fbde65, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:16.019680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515afcf0-11e8-4894-9313-eaf28b35ca95 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:16.021398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939f2e9846154e1bb2bfd8f82b919c8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:16.022284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939f2e9846154e1bb2bfd8f82b919c8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:16.023058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939f2e9846154e1bb2bfd8f82b919c8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:16.030228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:16.032926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939f2e9846154e1bb2bfd8f82b919c8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:16.035680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 923/1846] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:15 2022] PUT /identity/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa/users/d200eb2fbdf844e2aa7b9f14a6fbde65/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:16.046305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:16.047850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:16.048366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:16.060957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939f2e9846154e1bb2bfd8f82b919c8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:16.097286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] MFA Rules not processed for user `d200eb2fbdf844e2aa7b9f14a6fbde65`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:16.099666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:16.100725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 924/1847] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:15 2022] DELETE /identity/v3/users/939f2e9846154e1bb2bfd8f82b919c8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:16.136884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:16.209084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 924/1848] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:16.270379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:16.270379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:16.379585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c83b1-85bd-4d54-96d8-cba638cdcafd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:16.386271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:16.388616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:16.390014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:16.390567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:16.406950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:16.412924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:16.431605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 925/1849] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:16.770338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:16.780495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d8d0-b550-41ed-b1a4-e462157847d1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:16.797527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:16.798232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:16.798517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:16.798794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:16.808230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:16.860159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:16.861744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:16.964063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:16.968979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0208b-8c55-4f1a-9a5a-f354542af889 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:16.998772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 925/1850] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:17.003690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52227b-6ef0-47e6-9815-cdf76fd450ce service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.009771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.011055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.011589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.012089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] PATH_INFO: `/v3/projects/be657d46c06e4663852edec29dc0eda0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.013727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=be657d46c06e4663852edec29dc0eda0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:17.016540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:17.127247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be657d46c06e4663852edec29dc0eda0', 'request_id': 'req-81539b12-10a4-4203-b202-3fb8e34ee2cd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:17.139468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be657d46c06e4663852edec29dc0eda0', 'request_id': 'req-81539b12-10a4-4203-b202-3fb8e34ee2cd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:17.149540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be657d46c06e4663852edec29dc0eda0', 'request_id': 'req-81539b12-10a4-4203-b202-3fb8e34ee2cd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:17.197644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] The token cache is being invalidate because project be657d46c06e4663852edec29dc0eda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:17.197976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:17.198709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81539b12-10a4-4203-b202-3fb8e34ee2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:17.200332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 926/1851] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:16 2022] DELETE /identity/v3/projects/be657d46c06e4663852edec29dc0eda0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:17.205383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.205659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.206158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.295946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:17.313962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:17.492913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 926/1852] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:17.500778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.501102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.501985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.513952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:17.565107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:17.565107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:17.596899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 927/1853] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:17.601740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:17.618298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d826023-c5e2-44be-a322-4593a8706fe3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.639203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.641788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.643077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.643077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.644133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:17.644447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:17.648075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:17.686513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 927/1854] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:17.688388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:17.701395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124bb6d-baf6-4252-81d9-de3ac4d68359 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.715562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.717652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.720065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.720564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.721782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:17.724549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:17.766142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 928/1855] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:17 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:17.770564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:17.787233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49e3e9-afa6-4bd8-a2df-d6654d31e44a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.861690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:17.880409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.881094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.881378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.881646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.882737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:17.885215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:17.918060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 928/1856] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:17 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:17.918762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:17.932154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04167f52-1a38-46e7-80c0-cc5a66535e1a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.939077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.939935 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.941239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.941657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:17.942821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:17.944853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:17.962242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 929/1857] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:17.969377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:17.982355 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97950ab-bec7-41c8-ac62-10b662de0d0a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:17.993064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:17.994636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:17.995846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:17.997295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.003384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.009640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fd9ca-ba42-440c-813b-fcd6ddd8ba9c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:18.033728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 929/1858] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:18.038271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:18.061956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc964d-9b08-45df-a61b-83d9dfeac33f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:18.085877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:18.087960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.088244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.090015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] PATH_INFO: `/v3/projects/ea9682cf80e046668e47ac71dfd28991/users/139d6e346b6143a1852ce56d3dcbc312/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.159887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9682cf80e046668e47ac71dfd28991, user_id=139d6e346b6143a1852ce56d3dcbc312, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.168848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:18.214776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 930/1859] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:18 2022] PUT /identity/v3/projects/ea9682cf80e046668e47ac71dfd28991/users/139d6e346b6143a1852ce56d3dcbc312/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:18.229040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.229319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.229754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.322824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] MFA Rules not processed for user `139d6e346b6143a1852ce56d3dcbc312`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:18.325866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:18.531092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 930/1860] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:18.535964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:18.667747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aad833-6a95-4131-b5d8-6bae8f1a264d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:18.678429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:18.679404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.679762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.679962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.680687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.684878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:18.720393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 931/1861] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:18 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:18.724819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:18.739573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22e49-3bed-4b7b-b152-9011019abbc4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:18.855169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:18.856625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.857125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.857613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.858547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.860682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:18.894803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 931/1862] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:18 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:18.899620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:18.913802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d6ad8-e1b5-43cf-9bd9-cd3c0924f4e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:18.920430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:18.921149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.921416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.922047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.922399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.924274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:18.939266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 932/1863] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:18.943796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:18.956375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa9ac7-d6c3-4e2a-915f-64aefaef529d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:18.964318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:18.965521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:18.966069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:18.966756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] PATH_INFO: `/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5/users/9718ca462e20493d872c7f82ad2ef925/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:18.989299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d2f8ce860a4cbcae1c45caee4828b5, user_id=9718ca462e20493d872c7f82ad2ef925, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:18.992042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:19.007170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 932/1864] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:18 2022] PUT /identity/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5/users/9718ca462e20493d872c7f82ad2ef925/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:19.010931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:19.022940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17325c-db46-4074-83f6-7ad5c35540d1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:19.089841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:19.091217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.091543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.091893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:19.092705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:19.094680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03331280-3f3a-49a9-8194-bb3b90c7b6ab admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:19.107835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 933/1865] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:19.112318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:19.133447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4a32c-04ab-46c1-939b-167f6d581259 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:19.139238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:19.139610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.139900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.140495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] PATH_INFO: `/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5/users/9718ca462e20493d872c7f82ad2ef925/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:19.142913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d2f8ce860a4cbcae1c45caee4828b5, user_id=9718ca462e20493d872c7f82ad2ef925, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:19.147021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:19.167906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 933/1866] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:19 2022] PUT /identity/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5/users/9718ca462e20493d872c7f82ad2ef925/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:19.180113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.181019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.181019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:19.207499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:19.226581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] MFA Rules not processed for user `9718ca462e20493d872c7f82ad2ef925`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:19.234098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:19.337891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 934/1867] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:19.387728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:19.389787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:19.404200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:19.486482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5e70-c0eb-4c34-9142-df7859a3ffee admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:19.494102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:19.495286 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.495753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.496117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:19.511884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:19.514227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa7f-4412-41fa-a551-821088b367b8 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:19.552259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 934/1868] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:19.677284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:19.678813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:19.769666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e8519-f196-4ffe-a5d5-975145f8b5eb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:19.792776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:19.795364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.796094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.796557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] PATH_INFO: `/v3/users/51cdb17aa77649c5aac662e322a34f87` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:19.798286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cdb17aa77649c5aac662e322a34f87)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:19.803786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:19.884196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cdb17aa77649c5aac662e322a34f87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:19.887028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cdb17aa77649c5aac662e322a34f87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:19.888478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cdb17aa77649c5aac662e322a34f87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:19.919536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cdb17aa77649c5aac662e322a34f87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:19.933696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cdb17aa77649c5aac662e322a34f87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:19.969966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 935/1869] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:19 2022] DELETE /identity/v3/users/51cdb17aa77649c5aac662e322a34f87 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:19.972021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:19.973481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:19.974121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.013834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:20.015077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.027000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:20.028621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.068728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:20.127243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 935/1870] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:20.141721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:20.143714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.174367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a11f-aaf6-4f4e-9dee-a0a283a8d5b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:20.188928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:20.189814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.190678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.190963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] PATH_INFO: `/v3/users/c1e897c526b340e7a37e702b6d7b3908` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.192224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e897c526b340e7a37e702b6d7b3908)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:20.194168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:20.241947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14beca0-8f5e-4379-ad24-60954d2d967e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:20.247775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:20.248765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.249043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.249573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.259413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:20.260915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3a2d3-bb5d-47dc-92d2-d25aee9695fb service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:20.262894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e897c526b340e7a37e702b6d7b3908'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.263550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e897c526b340e7a37e702b6d7b3908'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.264281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e897c526b340e7a37e702b6d7b3908'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.272888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 936/1871] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:20.273600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e897c526b340e7a37e702b6d7b3908'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.284752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e897c526b340e7a37e702b6d7b3908'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.310824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 936/1872] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:20 2022] DELETE /identity/v3/users/c1e897c526b340e7a37e702b6d7b3908 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:20.312249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.312541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.312820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.331322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:20.332714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.401701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:20.419616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 937/1873] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:20.427187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:20.430211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.522478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c045f2-7ec8-4948-919d-83c3d7e2bb4a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:20.527573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:20.528588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.529218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.529697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.552389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:20.553849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:20.573822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 937/1874] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:20.625188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:20.627179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:20.654328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee1bc6-dea0-432a-be21-5f8aca8656a0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:20.660552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:20.662126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.662126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.662126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] PATH_INFO: `/v3/projects/b0d7ac0c62d24a23a70d8ce9b0e052cb` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.664506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d7ac0c62d24a23a70d8ce9b0e052cb)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:20.666467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:20.785457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d7ac0c62d24a23a70d8ce9b0e052cb', 'request_id': 'req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.800672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d7ac0c62d24a23a70d8ce9b0e052cb', 'request_id': 'req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.827963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d7ac0c62d24a23a70d8ce9b0e052cb', 'request_id': 'req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.866392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] The token cache is being invalidate because project b0d7ac0c62d24a23a70d8ce9b0e052cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:20.866680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.868093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7dcf6b5-2fc5-4e1b-a7e4-ece3a3257616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:20.871161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 938/1875] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:20 2022] DELETE /identity/v3/projects/b0d7ac0c62d24a23a70d8ce9b0e052cb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:20.878188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:20.897662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d67e-7c49-4bba-9f36-7a851c7940e8 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.897662 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d67e-7c49-4bba-9f36-7a851c7940e8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.898009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d67e-7c49-4bba-9f36-7a851c7940e8 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:20.899649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 939/1876] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:27:20.902219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0db2-8ddc-417f-87f0-7df7acb8694e service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:20.919248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:20.919574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:20.919855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:21.000811 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:21.007599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:21.010385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.071208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:21.072222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:21.072604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:21.072977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] PATH_INFO: `/v3/users/ac5197aa8133454da263e70a68413aa6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:21.074507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5197aa8133454da263e70a68413aa6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:21.079033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:21.175656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5197aa8133454da263e70a68413aa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.176959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5197aa8133454da263e70a68413aa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.180047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 940/1877] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:21.180468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:21.180875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5197aa8133454da263e70a68413aa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.182526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.202384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5197aa8133454da263e70a68413aa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.222099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5197aa8133454da263e70a68413aa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.263379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 938/1878] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:20 2022] DELETE /identity/v3/users/ac5197aa8133454da263e70a68413aa6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:21.263379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:21.263379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.316751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0d246-4ac9-47f7-8e50-95234d1260c8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:21.367688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:21.405002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac690-2e44-43f2-abfe-55f097c4c579 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:21.415696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:21.421988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:21.422452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:21.423092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:21.423378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:21.423757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:21.424128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:21.424336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] PATH_INFO: `/v3/projects/f071d35ec7d34784b62b5fc1d3a62fcd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:21.428147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f071d35ec7d34784b62b5fc1d3a62fcd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:21.429281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.435088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:21.601118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f071d35ec7d34784b62b5fc1d3a62fcd', 'request_id': 'req-a6c91560-c587-42f3-a6f5-3f7459f7b870'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.618983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f071d35ec7d34784b62b5fc1d3a62fcd', 'request_id': 'req-a6c91560-c587-42f3-a6f5-3f7459f7b870'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.620871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:21.633391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f071d35ec7d34784b62b5fc1d3a62fcd', 'request_id': 'req-a6c91560-c587-42f3-a6f5-3f7459f7b870'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.644679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:21.651560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:21.676713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] The token cache is being invalidate because project f071d35ec7d34784b62b5fc1d3a62fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:21.677168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.678581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:21.681865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 939/1879] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:21 2022] DELETE /identity/v3/projects/f071d35ec7d34784b62b5fc1d3a62fcd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:21.685799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:21.691688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 941/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:21.703121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.850643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91560-c587-42f3-a6f5-3f7459f7b870 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:21.864173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:21.869133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:21.869557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:21.870290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] PATH_INFO: `/v3/users/d200eb2fbdf844e2aa7b9f14a6fbde65` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:21.872067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d200eb2fbdf844e2aa7b9f14a6fbde65)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:21.872187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:21.873550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:21.876676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.012890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd200eb2fbdf844e2aa7b9f14a6fbde65'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.015808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd200eb2fbdf844e2aa7b9f14a6fbde65'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.016848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd200eb2fbdf844e2aa7b9f14a6fbde65'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.028743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd200eb2fbdf844e2aa7b9f14a6fbde65'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.038809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd200eb2fbdf844e2aa7b9f14a6fbde65'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.062819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7aa15-a483-4d62-99f8-9a8189c3cd99 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.088310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 940/1881] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:21 2022] DELETE /identity/v3/users/d200eb2fbdf844e2aa7b9f14a6fbde65 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:22.090278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.100372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.157425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.158073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.158406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.158692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.162249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.177047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.179437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.193792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 942/1882] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:22.202138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75c65a-b1c6-4429-bcf5-1c825808fcfa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.208704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.209437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.209811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.210296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] PATH_INFO: `/v3/users/139d6e346b6143a1852ce56d3dcbc312` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.211792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139d6e346b6143a1852ce56d3dcbc312)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.214209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.223405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:22.223592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.225261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.239783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:22.250198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445bdcd-1ca4-4f22-b952-1d8da8dd009e service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.259429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.261229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.261665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.262223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] PATH_INFO: `/v3/projects/d9dce372bbf7425f819425db7e334199` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.263800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9dce372bbf7425f819425db7e334199)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.270341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.336083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139d6e346b6143a1852ce56d3dcbc312'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.339802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139d6e346b6143a1852ce56d3dcbc312'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.340761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139d6e346b6143a1852ce56d3dcbc312'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.361450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139d6e346b6143a1852ce56d3dcbc312'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.382104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-06acd224-04f9-4886-9202-0e27be25e487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139d6e346b6143a1852ce56d3dcbc312'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.389478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9dce372bbf7425f819425db7e334199', 'request_id': 'req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.403357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9dce372bbf7425f819425db7e334199', 'request_id': 'req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.421529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9dce372bbf7425f819425db7e334199', 'request_id': 'req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.429121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 941/1883] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:22 2022] DELETE /identity/v3/users/139d6e346b6143a1852ce56d3dcbc312 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:22.431496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.431970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.433124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.449493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] The token cache is being invalidate because project d9dce372bbf7425f819425db7e334199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:22.449924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.450828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-dd0ec27c-b134-44b7-a4ec-6d5037ad5266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:22.458648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 943/1884] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:22 2022] DELETE /identity/v3/projects/d9dce372bbf7425f819425db7e334199 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:22.462222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803070dd-27bd-447f-8fa3-864c3d9528ae None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.462600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803070dd-27bd-447f-8fa3-864c3d9528ae None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.463456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803070dd-27bd-447f-8fa3-864c3d9528ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.484859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:22.486131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.522248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-803070dd-27bd-447f-8fa3-864c3d9528ae None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:22.523692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-803070dd-27bd-447f-8fa3-864c3d9528ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.641812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 944/1885] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:22.650032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.650562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.650859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.676788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:22.678164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.698037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 945/1886] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:22.699136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.710443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 942/1887] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:22.717979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46059c03-1907-4032-acbf-4f36207efb27 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.725841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.726656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.726941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.727226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.728747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:22.729062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.740927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.751343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 946/1888] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:22.753047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.766732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890ba6-c8ae-40ec-bc29-049fa33ebc91 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.774721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.775619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.775951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.776233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.776983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.781205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.788344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.790129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:22.865048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 943/1889] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:22 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:22.869025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:22.925796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c601fa6-8de7-47ab-a4cb-1b8d27b5c28f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.961265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0748c92-f860-469a-9a41-381ccce18996 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:22.969701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:22.969701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:22.970545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:22.970921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:22.973045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:22.975237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:22.985347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:22.987936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:23.012084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 944/1890] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:22 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:23.014161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.019879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.062417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3f594-7c36-4632-91fd-20174ee78f0b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.076467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.078123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.078724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.084178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] PATH_INFO: `/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.085922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2a94acd53146bcb9fb1a1e83d6c2fa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.089584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.090120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.092209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.092736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.093601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.134427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.136148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.150012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 947/1891] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:23.151262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.162829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b048-abb1-4d24-9241-f1c260510721 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.170162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.171184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.171685 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.172225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.173266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.176299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.193231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 948/1892] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:23.195257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.208018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d15db-bd5b-4aa6-be37-ff6d5b5b216f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.211029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2a94acd53146bcb9fb1a1e83d6c2fa', 'request_id': 'req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.229772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2a94acd53146bcb9fb1a1e83d6c2fa', 'request_id': 'req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.242539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2a94acd53146bcb9fb1a1e83d6c2fa', 'request_id': 'req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.269929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] The token cache is being invalidate because project be2a94acd53146bcb9fb1a1e83d6c2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:23.270706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.270947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab609cc1-c211-439b-a1f0-5f56d64ed2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.272894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 945/1893] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:23 2022] DELETE /identity/v3/projects/be2a94acd53146bcb9fb1a1e83d6c2fa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:23.277978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9859f2-ddba-4407-9cb2-44af43cec716 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.278276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9859f2-ddba-4407-9cb2-44af43cec716 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.278588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9859f2-ddba-4407-9cb2-44af43cec716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.314660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe9859f2-ddba-4407-9cb2-44af43cec716 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:23.316203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe9859f2-ddba-4407-9cb2-44af43cec716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.326706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.327517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.327714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.327949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.328851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.330365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.343025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 949/1894] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:23.347348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.349498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.364371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175729e-7eb9-413b-ab90-a7a080d6e416 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.371725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.372934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.373367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.373745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] PATH_INFO: `/v3/projects/79a2948d5ca04b7baf05a001a8c57ddf/users/5832f02a8c52418eac1c1bed74ca36cf/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.393221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a2948d5ca04b7baf05a001a8c57ddf, user_id=5832f02a8c52418eac1c1bed74ca36cf, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.396119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f1b9f-7b14-4254-90d9-745174dbb885 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.407802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 946/1895] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:23.417302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 950/1896] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:23 2022] PUT /identity/v3/projects/79a2948d5ca04b7baf05a001a8c57ddf/users/5832f02a8c52418eac1c1bed74ca36cf/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:23.418367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.418658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.418936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.428112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.428433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.428687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.454435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:23.456094 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.459167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] MFA Rules not processed for user `5832f02a8c52418eac1c1bed74ca36cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:23.460392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.531093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 947/1897] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:23.536724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.539328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 951/1898] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:23.548964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09357d1c-8c18-4d5f-b9d5-3749e5fca19a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.553164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.554663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.554881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.555638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.556045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.556406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.557248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:23.558146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.559377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.573652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 948/1899] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:23.582329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.588623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:23.593318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83d09-c92c-4931-815f-1e34c18f57e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.595254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:23.599795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.600576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.601009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.601471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.602386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.604799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.645750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba1e5-75d5-46c8-bdef-cc6602f2b983 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.650372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.651382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.651382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.651639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.653283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 949/1900] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:23.654169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.661755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.663709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.675478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 952/1901] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:23.732522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698eaff-dea5-4a3e-9de7-2886bc667892 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.740304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.741022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.741308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.741582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.742325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.744252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.773022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 950/1902] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:23.774241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.778910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.781137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.794581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e866-413b-4916-94bc-db41be3753f3 service glance] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.795834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44027735-fd17-4565-9370-d72fe844df13 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.799678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.800550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.801410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.801690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.801982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] PATH_INFO: `/v3/projects/ea9682cf80e046668e47ac71dfd28991` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.802183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.802475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.802759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.803171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9682cf80e046668e47ac71dfd28991)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.803470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.805133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.805249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.817827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 953/1903] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:23.821736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.832554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad076-666d-4f2b-8861-58f24af24191 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.837660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.838455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.838849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.839298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.840133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.842016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.853930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 954/1904] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:23.858121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.870417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af07f4-44cb-4899-9553-e36ad4cdf41e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:23.871516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9682cf80e046668e47ac71dfd28991', 'request_id': 'req-9904dbb1-f03b-41ec-9702-0e98758e8950'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.881360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9682cf80e046668e47ac71dfd28991', 'request_id': 'req-9904dbb1-f03b-41ec-9702-0e98758e8950'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.888841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9682cf80e046668e47ac71dfd28991', 'request_id': 'req-9904dbb1-f03b-41ec-9702-0e98758e8950'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.905188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] The token cache is being invalidate because project ea9682cf80e046668e47ac71dfd28991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:23.905480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.906156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:23.913981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 951/1905] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:23 2022] DELETE /identity/v3/projects/ea9682cf80e046668e47ac71dfd28991 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:23.915100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:23.916825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:23.938814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:23.939959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.940252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.940511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] PATH_INFO: `/v3/projects/4ccf875a03c54946924d3a0f07ae1a2c/users/12d9955dfd7d45948a4371c3218000eb/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.958475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccf875a03c54946924d3a0f07ae1a2c, user_id=12d9955dfd7d45948a4371c3218000eb, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:23.961168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2f54-828b-4e4b-ac60-04a1f4d76daf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:23.977597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 955/1906] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:23 2022] PUT /identity/v3/projects/4ccf875a03c54946924d3a0f07ae1a2c/users/12d9955dfd7d45948a4371c3218000eb/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:23.982718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:23.983224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:23.983610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:23.987377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:23.995460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dbb1-f03b-41ec-9702-0e98758e8950 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:24.007052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:24.008284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:24.063308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:24.064342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:24.064721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:24.065120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] PATH_INFO: `/v3/users/9718ca462e20493d872c7f82ad2ef925` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:24.066677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9718ca462e20493d872c7f82ad2ef925)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:24.069168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:24.086082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 956/1907] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:24.098536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:24.101726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:24.129004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9718ca462e20493d872c7f82ad2ef925'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:24.129695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9718ca462e20493d872c7f82ad2ef925'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:24.130626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9718ca462e20493d872c7f82ad2ef925'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:24.137605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:24.144540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9718ca462e20493d872c7f82ad2ef925'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:24.159899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9718ca462e20493d872c7f82ad2ef925'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:24.194498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 952/1908] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:23 2022] DELETE /identity/v3/users/9718ca462e20493d872c7f82ad2ef925 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:24.210397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c005312-7c79-427f-88ae-d262b002cd23 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:24.353428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:24.354127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:24.354342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:24.354599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:24.368767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:24.547780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:24.549399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:24.562107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 957/1909] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:25.052348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.053891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.082851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2903b-eb98-4049-acb2-2f3add435280 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.091331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.093331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.103350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.105998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.110189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.111069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] PATH_INFO: `/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.115439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d2f8ce860a4cbcae1c45caee4828b5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.117554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.128767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b6bd-4ce9-4de1-861b-709778d50d46 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.134475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.135417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.135719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.135988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] PATH_INFO: `/v3/users/c0f1f9b72f3f477e94dcacd5e09030d6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.137471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f1f9b72f3f477e94dcacd5e09030d6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.139678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.234374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f1f9b72f3f477e94dcacd5e09030d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.235217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f1f9b72f3f477e94dcacd5e09030d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.236099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f1f9b72f3f477e94dcacd5e09030d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.244744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d2f8ce860a4cbcae1c45caee4828b5', 'request_id': 'req-62a3321c-b9de-4adc-8074-58b8185e7847'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.253879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f1f9b72f3f477e94dcacd5e09030d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.255222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d2f8ce860a4cbcae1c45caee4828b5', 'request_id': 'req-62a3321c-b9de-4adc-8074-58b8185e7847'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.262748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-419c730f-9aa2-423b-bb76-23a465bf6f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f1f9b72f3f477e94dcacd5e09030d6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.264066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d2f8ce860a4cbcae1c45caee4828b5', 'request_id': 'req-62a3321c-b9de-4adc-8074-58b8185e7847'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.275487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:25.286166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 958/1910] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:25 2022] DELETE /identity/v3/users/c0f1f9b72f3f477e94dcacd5e09030d6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:25.290871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] The token cache is being invalidate because project c8d2f8ce860a4cbcae1c45caee4828b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:25.291180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.291949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.292446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-62a3321c-b9de-4adc-8074-58b8185e7847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:25.292668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.293282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.295906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 953/1911] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:25 2022] DELETE /identity/v3/projects/c8d2f8ce860a4cbcae1c45caee4828b5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:25.319034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a274707-7615-41d3-affb-aa99ddde0896 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.319446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a274707-7615-41d3-affb-aa99ddde0896 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.319702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a274707-7615-41d3-affb-aa99ddde0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.321127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:25.324215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.347745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:25.386366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7a274707-7615-41d3-affb-aa99ddde0896 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:25.388345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7a274707-7615-41d3-affb-aa99ddde0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.423797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 959/1912] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:25.455003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.458525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.539167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 954/1913] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:25.546410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.546410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.548104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.574002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:25.575389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.575973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ab6de-e72d-44cc-a72e-3d95fe8f79bc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.581039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.581878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.582350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.582788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.585088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 955/1914] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:25.589469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.595959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.598536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.599996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812e789-2c70-4e81-8213-94b3ae771602 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.605303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.606112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.606467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.607044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.610304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:25.610810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.611045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 960/1915] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:25.614497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.630452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 956/1916] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:25.636155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.647658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fec88-2507-4567-9773-293ef86cf261 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.652888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.653570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.654013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.654302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.655004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.656934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586ca5-aeca-4bca-af14-c3cce8462965 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.692135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 961/1917] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:25.696479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.714799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d14036-8e62-4a7f-97ef-346e1bb66c8e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.815542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.815542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.815542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.815542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.815851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.818298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.851664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.852320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.852803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.860347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 957/1918] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:25.861275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.878358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878e66-599c-4267-a4f6-b0130863cbc7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.883611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.884220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.884498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.884888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.885637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.886091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] MFA Rules not processed for user `12d9955dfd7d45948a4371c3218000eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:25.887531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.887737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:25.908029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 958/1919] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:25.911931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.925215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da0b3-45b4-4aaa-ada0-a34c5bf25b52 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.931010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.932412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.932708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.933182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.935988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:25.937651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:25.953401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 959/1920] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:25.957622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:25.970930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e6e9-067f-4b3e-9ac0-609ac31a414d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:25.977191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:25.978774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:25.979211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:25.979644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] PATH_INFO: `/v3/projects/786ebcfcf14949afbb5dd569d94e8d73/users/6ff91b747cee4dfcafabf2b6605c8a24/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:25.998918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 962/1921] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:26.006244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.007658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.011758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=786ebcfcf14949afbb5dd569d94e8d73, user_id=6ff91b747cee4dfcafabf2b6605c8a24, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.019635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044d6a9-3ea8-49cb-8bab-6e963416e24d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.040774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15db516-f5f2-4259-aa33-61a8418065b6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.051331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 960/1922] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:25 2022] PUT /identity/v3/projects/786ebcfcf14949afbb5dd569d94e8d73/users/6ff91b747cee4dfcafabf2b6605c8a24/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:26.061461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867511-8604-4230-9b52-8fea772b578b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.061747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867511-8604-4230-9b52-8fea772b578b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.062046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867511-8604-4230-9b52-8fea772b578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.066723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:26.118777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-85867511-8604-4230-9b52-8fea772b578b None None] MFA Rules not processed for user `6ff91b747cee4dfcafabf2b6605c8a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:26.120750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85867511-8604-4230-9b52-8fea772b578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.151837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:26.182904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.184050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.184547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.184945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.185871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.188368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.211002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 961/1923] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:26.212096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867511-8604-4230-9b52-8fea772b578b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.213628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85867511-8604-4230-9b52-8fea772b578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.229283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867511-8604-4230-9b52-8fea772b578b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.235713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.237332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.238449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.238449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] PATH_INFO: `/v3/projects/735a4eb530ba4cefb7b0d0177d0eb2d5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.240477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=735a4eb530ba4cefb7b0d0177d0eb2d5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.242612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.264915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 963/1924] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:26.265855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.326473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735a4eb530ba4cefb7b0d0177d0eb2d5', 'request_id': 'req-600437e2-4fd5-4838-94f2-72bb57d84ecb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.336262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735a4eb530ba4cefb7b0d0177d0eb2d5', 'request_id': 'req-600437e2-4fd5-4838-94f2-72bb57d84ecb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.350312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735a4eb530ba4cefb7b0d0177d0eb2d5', 'request_id': 'req-600437e2-4fd5-4838-94f2-72bb57d84ecb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.365810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] The token cache is being invalidate because project 735a4eb530ba4cefb7b0d0177d0eb2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:26.366446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.367310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.368895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 962/1925] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:26 2022] DELETE /identity/v3/projects/735a4eb530ba4cefb7b0d0177d0eb2d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:26.369778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.371090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.378889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8ee9-4e3a-412f-9dd5-15c8292dd155 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.448045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600437e2-4fd5-4838-94f2-72bb57d84ecb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.449991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.452348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.452643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.453156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.453552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.453970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.454254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.454663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.454834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.455500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.458366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.458496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.488638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 963/1926] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:26 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:26.489651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.492632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.508904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d057-b7be-41e2-8634-ddacb3004f55 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.509860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 964/1927] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:26.511247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.558999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:26.559776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:26.598392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae079f-0295-477d-95d7-33cb8b15a54b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.604163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.605233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.605518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.605790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] PATH_INFO: `/v3/users/163238a64b554bcb8cbfdaed758ab94a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.606738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.607060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163238a64b554bcb8cbfdaed758ab94a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.607819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.608256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.608779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.609178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.609958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.613861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.636697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 965/1928] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:26.642282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.645772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.667331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e6e69-65da-4127-9c35-570d276d6443 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.678931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.679541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.679849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.680085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.680785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.683450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.697996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163238a64b554bcb8cbfdaed758ab94a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.699236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163238a64b554bcb8cbfdaed758ab94a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.704335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163238a64b554bcb8cbfdaed758ab94a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.725589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163238a64b554bcb8cbfdaed758ab94a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.725749 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 966/1929] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:26 2022] POST /identity/v3/users => generated 294 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:26.726293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.730144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.737375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163238a64b554bcb8cbfdaed758ab94a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:26.748179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef6de1-bc0c-47ae-8a72-ecd14f985997 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.753828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.754750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.755030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.755308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] PATH_INFO: `/v3/projects/0d0e7cea340f4683b556ce7cea4b8585/users/b91c264e531e4b1192c72a12300249ac/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.761970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 964/1930] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:26 2022] DELETE /identity/v3/users/163238a64b554bcb8cbfdaed758ab94a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:26.762955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.764385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:26.771666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0e7cea340f4683b556ce7cea4b8585, user_id=b91c264e531e4b1192c72a12300249ac, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.774350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.790826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 967/1931] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:26 2022] PUT /identity/v3/projects/0d0e7cea340f4683b556ce7cea4b8585/users/b91c264e531e4b1192c72a12300249ac/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:26.794905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.878687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab623c70-ef77-4bf8-9283-deb83891f124 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.885451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.886478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0fecc-71ef-4a74-971a-3d6f00ccd90f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.886626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.886797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.887047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.887781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.889508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.892761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.893495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.893776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.894121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.894820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.897028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.904988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 965/1932] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:26.907060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.916783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 968/1933] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:26.918008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:26.932180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbb92c-c69f-4fb1-a6d7-eb4498d64717 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.935633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704beb0-77ca-481d-9746-1d1847f8ab10 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:26.946452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.947399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.947655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.947934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] PATH_INFO: `/v3/projects/0d0e7cea340f4683b556ce7cea4b8585/users/b91c264e531e4b1192c72a12300249ac/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.949931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0e7cea340f4683b556ce7cea4b8585, user_id=b91c264e531e4b1192c72a12300249ac, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.952268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:26.953118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.953657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:26.954215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:26.954673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] PATH_INFO: `/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044/users/b802254fc7824eb7afc14f4fb8210758/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:26.968325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 969/1934] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:26 2022] PUT /identity/v3/projects/0d0e7cea340f4683b556ce7cea4b8585/users/b91c264e531e4b1192c72a12300249ac/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:26.976586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4c771a3bed43f5be3c4cc5fc118044, user_id=b802254fc7824eb7afc14f4fb8210758, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:26.979556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:26.998009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 966/1935] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:26 2022] PUT /identity/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044/users/b802254fc7824eb7afc14f4fb8210758/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:27.003820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:27.109287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ff968-c218-49a2-b26a-f95824a29caa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:27.154526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:27.272434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:27.273939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.274487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.274949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.276115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:27.278791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed99d50-5ebc-4cb3-9c2c-cd60a13f470f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:27.298483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:27.300128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 970/1936] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:27.313065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346b4c-1801-4895-86c1-19dd9612e1b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:27.321025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:27.322489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.323174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.323695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] PATH_INFO: `/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044/users/b802254fc7824eb7afc14f4fb8210758/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.327016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4c771a3bed43f5be3c4cc5fc118044, user_id=b802254fc7824eb7afc14f4fb8210758, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:27.332431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:27.360002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 967/1937] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:27 2022] PUT /identity/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044/users/b802254fc7824eb7afc14f4fb8210758/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:27.363378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.364041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.364041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.374667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:27.377109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:27.411111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:27.419249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] MFA Rules not processed for user `b802254fc7824eb7afc14f4fb8210758`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:27.420498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:27.543903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ddee8-dcb1-491e-9b27-fbf5822129ca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:27.549508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:27.551119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.551475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.551762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] PATH_INFO: `/v3/projects/7f6da457e7cd4070ace166cce0c2f883` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.553020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6da457e7cd4070ace166cce0c2f883)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:27.565064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:27.599527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 971/1938] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:27.615739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:27.617616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:27.676052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6da457e7cd4070ace166cce0c2f883', 'request_id': 'req-f5a015af-9669-4845-ab3a-cdc453d7696c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.687624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6da457e7cd4070ace166cce0c2f883', 'request_id': 'req-f5a015af-9669-4845-ab3a-cdc453d7696c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.697272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6da457e7cd4070ace166cce0c2f883', 'request_id': 'req-f5a015af-9669-4845-ab3a-cdc453d7696c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.715675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51627b6d-fbc5-4d30-bd2c-7def687cbdcc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:27.723128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] The token cache is being invalidate because project 7f6da457e7cd4070ace166cce0c2f883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:27.723457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.725362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.730679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 968/1939] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:27 2022] DELETE /identity/v3/projects/7f6da457e7cd4070ace166cce0c2f883 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:27.734370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:27.749498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:27.800792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:27.802113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.802418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.802701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.805029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:27.813745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:27.845728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a015af-9669-4845-ab3a-cdc453d7696c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:27.855552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:27.857152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:27.857445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:27.857717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] PATH_INFO: `/v3/users/bd9cc206cea04605adf8687d823499ec` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:27.859856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9cc206cea04605adf8687d823499ec)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:27.862584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:27.902537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:27.904071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cab83-cb46-4d51-8512-7607cb0a177e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:27.917169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 972/1940] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:27.925967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:27.939304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9cc206cea04605adf8687d823499ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.941815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9cc206cea04605adf8687d823499ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.942488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9cc206cea04605adf8687d823499ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.957505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9cc206cea04605adf8687d823499ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:27.971000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e9a870e1-5648-4739-8852-431635140655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9cc206cea04605adf8687d823499ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.001788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 969/1941] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:27 2022] DELETE /identity/v3/users/bd9cc206cea04605adf8687d823499ec => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:28.134175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:28.134748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:28.135049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:28.198257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] MFA Rules not processed for user `b91c264e531e4b1192c72a12300249ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:28.220865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.418094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 973/1942] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:28.421476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:28.422047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:28.422133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:28.446992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] MFA Rules not processed for user `12d9955dfd7d45948a4371c3218000eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:28.451474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.554021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 970/1943] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:28.683412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:28.685090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.742086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:28.743869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.807150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cfe4e-c842-4acc-be0c-79fbbabb90c2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:28.813371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:28.814201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:28.814553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:28.815533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:28.817362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.828510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:28.830153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ccd4a-6e8d-4554-829f-64af1509bf76 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:28.838607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fa491-5287-4de2-98ed-98957de26c2b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:28.840697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 974/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:28.844287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:28.845167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:28.845448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:28.845721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] PATH_INFO: `/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:28.847007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcafb90f0a2a4a35add0a27a337da2f9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:28.848920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:28.913859 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcafb90f0a2a4a35add0a27a337da2f9', 'request_id': 'req-000bfae2-f5cc-4077-b14c-f002ee699632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.920334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcafb90f0a2a4a35add0a27a337da2f9', 'request_id': 'req-000bfae2-f5cc-4077-b14c-f002ee699632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.926968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcafb90f0a2a4a35add0a27a337da2f9', 'request_id': 'req-000bfae2-f5cc-4077-b14c-f002ee699632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.929470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:28.944751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] The token cache is being invalidate because project bcafb90f0a2a4a35add0a27a337da2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:28.945180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.945855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-000bfae2-f5cc-4077-b14c-f002ee699632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:28.952041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 971/1945] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:28 2022] DELETE /identity/v3/projects/bcafb90f0a2a4a35add0a27a337da2f9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:28.953499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:28.954001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:28.956145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:28.980504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:28.981747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:28.993867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:29.062481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 975/1946] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:29.071600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.071880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.072148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.091430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:29.092821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:29.101757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 972/1947] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:29.106096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.116560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c3a5-856e-45f5-b4c5-1c62fcacb4c8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.122340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.123004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.123292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.123569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.124559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:29.124867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.126501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.142073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 976/1948] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:27:29.146447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.155666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cc76-7e14-4008-9991-100cafc08993 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.162098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.162962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.163358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.163516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.164215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.166701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.205407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 973/1949] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:29.209551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.220493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c46465-b79d-4051-84ec-004430ce978d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.292364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.293284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.293674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.294107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.294962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.297214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.324591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 977/1950] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:29.325998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.338418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76d318-2f6e-40ad-80f4-59222b08928e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.343261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.344126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.344430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.344777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.345579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.347335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.363306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 974/1951] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:29.366338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.378534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d48-49b9-4ce4-8d5d-9797169dbf1b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.384000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.384767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.385145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.385540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.386391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.388209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6aa50f-93b5-47f0-8c11-f8b07b19400f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.401944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 978/1952] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:29.404797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.417698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7ae96-7201-450c-9b9c-90e70cde491b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.422536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.423625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.424007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.425014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] PATH_INFO: `/v3/projects/b895cc098595455fa748f695e5e643c0/users/6fbcab0f5250460ba8b7dc76212804a3/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.441166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b895cc098595455fa748f695e5e643c0, user_id=6fbcab0f5250460ba8b7dc76212804a3, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.444339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.466106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 975/1953] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:29 2022] PUT /identity/v3/projects/b895cc098595455fa748f695e5e643c0/users/6fbcab0f5250460ba8b7dc76212804a3/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:29.477641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.478593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.479063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.531836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] MFA Rules not processed for user `6fbcab0f5250460ba8b7dc76212804a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:29.535794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:29.662762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 979/1954] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:29.667383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.763060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635d26-c743-4d55-8324-ece7ca7b54e8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.771855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.772584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.773089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.773821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.774682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.776915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.813490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 976/1955] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:29.817380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.831844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c7bae-8357-40fe-9fec-e398917b90fa None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.856072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:29.942549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.943424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.943739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.944100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.944809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:29.947066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:29.973773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 980/1956] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:29 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:29.978458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:29.991579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d84fb4-f6ef-4ceb-8923-09f9cc400afd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:29.996576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:29.997663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:29.997881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:29.998304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:29.999528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:30.001288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:30.016971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 977/1957] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:30.018827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:30.030191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46f721-207c-4e11-977a-192e4e42cbd6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:30.036941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:30.038315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.038646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.038887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] PATH_INFO: `/v3/projects/1733f318c1e54179bc15b7b5cbb527ef/users/410748db8c204f418c3f594532703fa6/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.059261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1733f318c1e54179bc15b7b5cbb527ef, user_id=410748db8c204f418c3f594532703fa6, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:30.062217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:30.077945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 981/1958] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:30 2022] PUT /identity/v3/projects/1733f318c1e54179bc15b7b5cbb527ef/users/410748db8c204f418c3f594532703fa6/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:30.081611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:30.094713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c881d22-a854-4a28-a3f4-53020f5e53b7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:30.161464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:30.162202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.162488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.162761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.163796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:30.165647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecfbcd-afad-413f-9253-967671370407 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:30.171496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:30.180454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 978/1959] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:30.181584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:30.192984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549290b6-9833-457d-bd68-753fc26694c6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:30.197606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:30.198545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.198820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.199111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] PATH_INFO: `/v3/projects/1733f318c1e54179bc15b7b5cbb527ef/users/410748db8c204f418c3f594532703fa6/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.201079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1733f318c1e54179bc15b7b5cbb527ef, user_id=410748db8c204f418c3f594532703fa6, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:30.203739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:30.215483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 982/1960] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:30 2022] PUT /identity/v3/projects/1733f318c1e54179bc15b7b5cbb527ef/users/410748db8c204f418c3f594532703fa6/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:30.228102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.228404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.228664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.259812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] MFA Rules not processed for user `410748db8c204f418c3f594532703fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:30.261078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:30.339834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 979/1961] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:30.352851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:30.355548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:30.473924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb064d25-ada6-4691-a7ae-e8d8c61d3e2f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:30.486574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:30.490845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.492157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.492544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.506824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:30.508343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:30.522150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 983/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:30.962120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:30.976114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294d74d-9cc5-4260-b98e-191c72337065 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:30.979811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:30.981155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:30.981453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:30.981938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:30.983977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:31.073279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:31.075872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e12042-69a5-4985-988a-e03d8d2035d4 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:31.091862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 980/1963] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:31.102915 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:31.172898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910eec5-1f57-49c2-83d8-755758849d51 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:31.178726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:31.182933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:31.183402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:31.183826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] PATH_INFO: `/v3/users/6fbcab0f5250460ba8b7dc76212804a3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:31.185356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbcab0f5250460ba8b7dc76212804a3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:31.187715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:31.195783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:31.258361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbcab0f5250460ba8b7dc76212804a3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:31.259152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbcab0f5250460ba8b7dc76212804a3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:31.259900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbcab0f5250460ba8b7dc76212804a3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:31.286071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbcab0f5250460ba8b7dc76212804a3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:31.294645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbcab0f5250460ba8b7dc76212804a3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:31.318241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 984/1964] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:31 2022] DELETE /identity/v3/users/6fbcab0f5250460ba8b7dc76212804a3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:31.319864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:31.320295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:31.322010 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:31.352215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:31.353843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:31.456913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 981/1965] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:31.479119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:31.480463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:31.591961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e1e8e-a0b3-473a-9a18-0dfc9aae1596 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:31.595667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:31.597103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:31.597391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:31.597669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:31.607697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:31.609183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:31.620431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 985/1966] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:32.031628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:32.034259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:32.064469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f3f79-654a-4b3e-b664-53b5fcddbfb5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:32.069779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:32.070994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:32.071386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:32.071726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] PATH_INFO: `/v3/projects/b895cc098595455fa748f695e5e643c0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:32.073342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b895cc098595455fa748f695e5e643c0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:32.076734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:32.098229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:32.140812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b895cc098595455fa748f695e5e643c0', 'request_id': 'req-7759f76b-7e9b-4b85-abd6-fac06254f499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.148398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b895cc098595455fa748f695e5e643c0', 'request_id': 'req-7759f76b-7e9b-4b85-abd6-fac06254f499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.154887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b895cc098595455fa748f695e5e643c0', 'request_id': 'req-7759f76b-7e9b-4b85-abd6-fac06254f499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.173618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] The token cache is being invalidate because project b895cc098595455fa748f695e5e643c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:32.174128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.174873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.176648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 982/1967] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:32 2022] DELETE /identity/v3/projects/b895cc098595455fa748f695e5e643c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:32.180712 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:32.190875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58cad2-0544-4459-ba63-0e0a609ab8b1 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:32.254074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:32.254887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:32.255168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:32.255444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] PATH_INFO: `/v3/users/410748db8c204f418c3f594532703fa6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:32.256638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410748db8c204f418c3f594532703fa6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:32.258641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:32.296753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:32.320127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410748db8c204f418c3f594532703fa6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.320829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410748db8c204f418c3f594532703fa6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.321468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410748db8c204f418c3f594532703fa6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.337414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410748db8c204f418c3f594532703fa6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.344847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-cd28cd92-24ce-4521-888e-966388474071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410748db8c204f418c3f594532703fa6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:32.360225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 986/1968] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:32 2022] DELETE /identity/v3/users/410748db8c204f418c3f594532703fa6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:32.777391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:32.780038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:32.816595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f76b-7e9b-4b85-abd6-fac06254f499 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:32.910854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:32.911726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:32.912008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:32.912282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] PATH_INFO: `/v3/projects/1733f318c1e54179bc15b7b5cbb527ef` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:32.913749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1733f318c1e54179bc15b7b5cbb527ef)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:32.915712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.005096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1733f318c1e54179bc15b7b5cbb527ef', 'request_id': 'req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:33.013380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1733f318c1e54179bc15b7b5cbb527ef', 'request_id': 'req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:33.026032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1733f318c1e54179bc15b7b5cbb527ef', 'request_id': 'req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:33.048794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] The token cache is being invalidate because project 1733f318c1e54179bc15b7b5cbb527ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:33.050082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:33.051152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b458f3f0-dbda-4fe2-a8e3-e4ff2a3520cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:33.054092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 983/1969] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:32 2022] DELETE /identity/v3/projects/1733f318c1e54179bc15b7b5cbb527ef => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:33.059274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.059817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.059817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.086981 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:33.088780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:33.182628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 987/1970] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:33.191151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.191857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.192230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.233864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:33.237562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:33.259291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 984/1971] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:33.264093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.280644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa418b-d0b9-4950-a71f-d6dfa8f79f72 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.302673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.303475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.303860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.304236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.305086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:33.305499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.309573 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.344541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 988/1972] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:33.349167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.364422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b85dda-9d8c-4fd1-a1ca-c21087224082 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.371283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.372125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.372510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.372886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.373698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.376296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.423188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 985/1973] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:33.427945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.440436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb27e-d5f8-4bbe-b02a-0598158a3686 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.530753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.531701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.532135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.532599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.534399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.536697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.581934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 989/1974] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:33.585996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.593924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:33.601524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024ad02-8d6b-4d70-a9c0-cb47029c8b8a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.609035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.610208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.610762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.612426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.613250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.614977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.629966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 986/1975] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:33.633913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.646383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854b10b-c08c-4d3d-9015-2ca462c4e985 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.652343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.653738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.654071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.654791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.655199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.657137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa63f2-429d-47c9-a7f5-e290242eaea6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.673542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 990/1976] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:33.674855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.697595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135b614-e1f0-45a1-b4d8-d58ba1effde3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:33.703204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:33.704090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.704370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.704642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] PATH_INFO: `/v3/projects/dcd9bdb0fcc0439fbb85ad1f67c41589/users/bd2cc3eee64540fe9776404e9a3b707e/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.720573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd9bdb0fcc0439fbb85ad1f67c41589, user_id=bd2cc3eee64540fe9776404e9a3b707e, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:33.723908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:33.759562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 987/1977] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:33 2022] PUT /identity/v3/projects/dcd9bdb0fcc0439fbb85ad1f67c41589/users/bd2cc3eee64540fe9776404e9a3b707e/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:33.770734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:33.771343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:33.771894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:33.830100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:33.835415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] MFA Rules not processed for user `bd2cc3eee64540fe9776404e9a3b707e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:33.836787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:33.954281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:33.958222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 991/1978] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:34.116513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be89cc-7228-4021-875c-8fadd91eea0a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.135018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.138758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.139386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.140105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.141025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.143628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.193302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 988/1979] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:34.196699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.211461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb73ac9-0706-4cd8-819f-0648ba244e69 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.315858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.316676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.317067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.317444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.318299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.320365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.367204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 992/1980] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:34 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:34.368733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.402976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940de8-1edc-4941-bf41-10466577c7f9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.415889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.417358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.419345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.419810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.423333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.426607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.458128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 989/1981] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:34.461251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.473793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e453-73f6-4e3a-9bbf-b66970486bc1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.480764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.482549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.483053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.483440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] PATH_INFO: `/v3/projects/43a26580e9244cbda68531040e238209/users/f7de378dfce24791955f17e1e35da21c/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.523362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a26580e9244cbda68531040e238209, user_id=f7de378dfce24791955f17e1e35da21c, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.527611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.553009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 993/1982] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:34 2022] PUT /identity/v3/projects/43a26580e9244cbda68531040e238209/users/f7de378dfce24791955f17e1e35da21c/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:34.556861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.569634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4fb9-943e-49f8-bae3-5ba2af6a5a71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.660338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.661309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.661598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.662160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.663204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.665254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d65e5-4968-47a6-9888-6c5038ef064c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.678803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 990/1983] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:34.682612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.700612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93470e5-d164-40d8-a4a5-5bf5b7927b41 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.708437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.711157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.711701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.712117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] PATH_INFO: `/v3/projects/43a26580e9244cbda68531040e238209/users/f7de378dfce24791955f17e1e35da21c/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.715395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a26580e9244cbda68531040e238209, user_id=f7de378dfce24791955f17e1e35da21c, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:34.719035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:34.742006 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 994/1984] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:34 2022] PUT /identity/v3/projects/43a26580e9244cbda68531040e238209/users/f7de378dfce24791955f17e1e35da21c/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:34.747073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.750855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.750855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.785577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] MFA Rules not processed for user `f7de378dfce24791955f17e1e35da21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:34.786825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:34.822659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:34.884235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 991/1985] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:34.896911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:34.898645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:34.965303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf6bf6-e56b-4bc1-88f4-0a64ccff6418 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:34.969026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:34.969789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:34.970219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:34.970597 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:34.982686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:35.054655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:35.056165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:35.070265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 995/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:39.825363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:39.835648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e149f4-8231-4ca5-966b-66dd3b8ab066 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:39.840714 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:39.841362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:39.841643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:39.841927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:39.852173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:39.853736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce58d57-dc70-4201-ae4d-ce38f57eb0e7 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:39.864187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 992/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:42.918351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:42.919737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:42.985116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be672-827d-47ac-a948-859a75626493 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:42.989646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:42.990661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:42.990885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:42.991159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] PATH_INFO: `/v3/users/5832f02a8c52418eac1c1bed74ca36cf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:42.992481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5832f02a8c52418eac1c1bed74ca36cf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:42.994519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:43.041556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5832f02a8c52418eac1c1bed74ca36cf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.042211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5832f02a8c52418eac1c1bed74ca36cf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.042837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5832f02a8c52418eac1c1bed74ca36cf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.056945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5832f02a8c52418eac1c1bed74ca36cf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.064346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5832f02a8c52418eac1c1bed74ca36cf'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.079562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 996/1988] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:42 2022] DELETE /identity/v3/users/5832f02a8c52418eac1c1bed74ca36cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:43.084643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.085060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.085467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.112260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:43.113774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:43.177556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 993/1989] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:43.187906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:43.189292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:43.222768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:43.256834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824f301-b54a-4808-9299-35f119791bbc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:43.260533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:43.261188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.261469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.261743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.271283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:43.272704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ede6f8-1754-4487-821d-b71b5a15bc60 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:43.283272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 997/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:43.648541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:43.650364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:43.666670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e0fa-02a3-46c2-b03d-c2b924b894e3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:43.671837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:43.673294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.674359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.674639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] PATH_INFO: `/v3/projects/79a2948d5ca04b7baf05a001a8c57ddf` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.676336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a2948d5ca04b7baf05a001a8c57ddf)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:43.679185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:43.730041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a2948d5ca04b7baf05a001a8c57ddf', 'request_id': 'req-60c4ff7f-f49b-43ec-b989-394b23dc9945'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.735588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a2948d5ca04b7baf05a001a8c57ddf', 'request_id': 'req-60c4ff7f-f49b-43ec-b989-394b23dc9945'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.742001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a2948d5ca04b7baf05a001a8c57ddf', 'request_id': 'req-60c4ff7f-f49b-43ec-b989-394b23dc9945'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.758242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] The token cache is being invalidate because project 79a2948d5ca04b7baf05a001a8c57ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:43.758555 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.759251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60c4ff7f-f49b-43ec-b989-394b23dc9945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:43.760879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 994/1991] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:43 2022] DELETE /identity/v3/projects/79a2948d5ca04b7baf05a001a8c57ddf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:43.765824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.766163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.766442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.788329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:43.789570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:43.849656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 998/1992] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:43.858699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.859057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.859402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.879304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:43.880531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:43.888877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 995/1993] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:43.893169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:43.903341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afb828-e2f9-4b8b-a898-429d153ed1fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:43.908337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:43.908999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.909279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.909590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.910346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:43.910674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:43.912226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:43.924864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 999/1994] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:43.929278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:43.938825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d0ee-6a4e-40af-aec6-785d962becb5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:43.944155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:43.944809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:43.945092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:43.945431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:43.946176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:43.948075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:43.979374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 996/1995] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:43.980349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:43.990855 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44650573-6b4c-442b-9222-9de57713a0fc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.049337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.049955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.050784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.051092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.051783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.053705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.075210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1000/1996] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:43 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:44.079201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.090261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fbe84-791a-4a86-9c19-bd7fbb617455 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.098566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.099470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.099934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.100260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.101153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.102967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.104426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:44.117291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 997/1997] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:44.121025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.132119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1685-5e6e-4bcb-a5e7-1ff5f12f1d91 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.136760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.137418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.137700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.138011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.138736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.140325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061763da-09d5-4d57-aef0-da0f3db753e0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.150758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1001/1998] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:44.154966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.165876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81443e94-f143-4800-9fc6-6e86995a4d87 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.170851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.171785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.172066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.172337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] PATH_INFO: `/v3/projects/10a6ddd5bb754f929b7f34b399c195c6/users/d8272fc2ef884a7ba016465eb8042bd1/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.187693 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6ddd5bb754f929b7f34b399c195c6, user_id=d8272fc2ef884a7ba016465eb8042bd1, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.193376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.207577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 998/1999] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:44 2022] PUT /identity/v3/projects/10a6ddd5bb754f929b7f34b399c195c6/users/d8272fc2ef884a7ba016465eb8042bd1/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:44.217450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.217744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.218060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.245205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] MFA Rules not processed for user `d8272fc2ef884a7ba016465eb8042bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:44.246961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.279520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:44.334246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1002/2000] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:44.344908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.346945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.413216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e20463-a7a4-4e47-b6d1-0cd803a1e42a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.417257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.418020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.418394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.418675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.429194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.430679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.440745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 999/2001] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:44.571168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.572654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.704048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc822a2f-8068-4e8f-8157-354f1936b622 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.710933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.712270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.712766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.713383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] PATH_INFO: `/v3/users/6ff91b747cee4dfcafabf2b6605c8a24` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.715545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff91b747cee4dfcafabf2b6605c8a24)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.718215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.802979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.804111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff91b747cee4dfcafabf2b6605c8a24'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.804791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff91b747cee4dfcafabf2b6605c8a24'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.805111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.805501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff91b747cee4dfcafabf2b6605c8a24'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.821680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff91b747cee4dfcafabf2b6605c8a24'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.828494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ecf2-0e6e-4d06-a5e1-ee792d9d212f service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:44.829514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e377a97c-e128-4f01-bf91-786660f9740e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff91b747cee4dfcafabf2b6605c8a24'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.841845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:44.842818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.843100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.845671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] PATH_INFO: `/v3/users/bd2cc3eee64540fe9776404e9a3b707e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.847435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2cc3eee64540fe9776404e9a3b707e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:44.847590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1003/2002] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:44 2022] DELETE /identity/v3/users/6ff91b747cee4dfcafabf2b6605c8a24 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:44.852411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:44.852885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:44.853505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:44.853972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:44.877007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:44.879064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.936138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:44.961493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2cc3eee64540fe9776404e9a3b707e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.962222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2cc3eee64540fe9776404e9a3b707e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.963034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2cc3eee64540fe9776404e9a3b707e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.963671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1004/2003] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:44.972743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2cc3eee64540fe9776404e9a3b707e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:44.975200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:44.977090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:44.983463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d672260a-8d9a-4a59-b26a-683396ecf2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2cc3eee64540fe9776404e9a3b707e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.005574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1000/2004] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:44 2022] DELETE /identity/v3/users/bd2cc3eee64540fe9776404e9a3b707e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:45.009620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.010041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.010411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.028325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:45.029700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.038180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a12d38-42a1-4e08-972e-6c2bf280a14d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:45.079447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:45.102547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:45.103535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.103688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.103968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.106020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1001/2005] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:45.106543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.121102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:45.122604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:45.123609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:45.125596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.133593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1005/2006] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:45.140077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79cba5-7773-433a-95a5-a0d8161d6d70 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:45.144499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:45.145300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.145706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.146131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.158506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:45.160736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:45.171086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1002/2007] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:45.700879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:45.702433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.716400 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d17af6-3057-4c63-a223-c27906859310 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:45.723192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:45.724197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.724491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.724845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] PATH_INFO: `/v3/projects/dcd9bdb0fcc0439fbb85ad1f67c41589` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.726429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd9bdb0fcc0439fbb85ad1f67c41589)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:45.728578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:45.734246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:45.740728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.782354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57547c29-809f-44da-b373-e4558f3a8237 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:45.817725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd9bdb0fcc0439fbb85ad1f67c41589', 'request_id': 'req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.825939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd9bdb0fcc0439fbb85ad1f67c41589', 'request_id': 'req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.838676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd9bdb0fcc0439fbb85ad1f67c41589', 'request_id': 'req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.853424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] The token cache is being invalidate because project dcd9bdb0fcc0439fbb85ad1f67c41589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:45.854023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.854754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.859992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1006/2008] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:45 2022] DELETE /identity/v3/projects/dcd9bdb0fcc0439fbb85ad1f67c41589 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:45.861819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:45.864455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:45.871153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:45.871996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.872339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.872680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] PATH_INFO: `/v3/projects/786ebcfcf14949afbb5dd569d94e8d73` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.874274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=786ebcfcf14949afbb5dd569d94e8d73)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:45.876436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:45.886929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1fd78-34bc-4f49-bfa4-dbae1feada0f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:45.893787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:45.895331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:45.895616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:45.895894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] PATH_INFO: `/v3/users/f7de378dfce24791955f17e1e35da21c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:45.897111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7de378dfce24791955f17e1e35da21c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:45.899209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:45.944123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786ebcfcf14949afbb5dd569d94e8d73', 'request_id': 'req-3f2acb90-b162-4a58-b8ac-0512748cee8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.954294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786ebcfcf14949afbb5dd569d94e8d73', 'request_id': 'req-3f2acb90-b162-4a58-b8ac-0512748cee8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:45.955527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:45.970000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786ebcfcf14949afbb5dd569d94e8d73', 'request_id': 'req-3f2acb90-b162-4a58-b8ac-0512748cee8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.011012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7de378dfce24791955f17e1e35da21c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.012205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7de378dfce24791955f17e1e35da21c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.012845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7de378dfce24791955f17e1e35da21c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.017649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] The token cache is being invalidate because project 786ebcfcf14949afbb5dd569d94e8d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:46.018256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.019706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.024771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1003/2009] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:45 2022] DELETE /identity/v3/projects/786ebcfcf14949afbb5dd569d94e8d73 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:46.027192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:46.028842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:46.033387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7de378dfce24791955f17e1e35da21c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.044214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7de378dfce24791955f17e1e35da21c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.080156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1007/2010] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:45 2022] DELETE /identity/v3/users/f7de378dfce24791955f17e1e35da21c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:46.178858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acb90-b162-4a58-b8ac-0512748cee8a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:46.202479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:46.311575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:46.311575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:46.311575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:46.322594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] PATH_INFO: `/v3/users/b802254fc7824eb7afc14f4fb8210758` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:46.327323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b802254fc7824eb7afc14f4fb8210758)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:46.329599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:46.406529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b802254fc7824eb7afc14f4fb8210758'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.407838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b802254fc7824eb7afc14f4fb8210758'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.410109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b802254fc7824eb7afc14f4fb8210758'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.424280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b802254fc7824eb7afc14f4fb8210758'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.436903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-05c1dbdf-fe30-488b-8b88-68e215db03f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b802254fc7824eb7afc14f4fb8210758'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.479680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1004/2011] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:46 2022] DELETE /identity/v3/users/b802254fc7824eb7afc14f4fb8210758 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:46.604003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:46.606362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:46.626666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ace21-708e-4d4d-9fc8-3ea3b17fe4ea admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:46.765397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:46.766713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:46.771518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:46.772154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] PATH_INFO: `/v3/projects/43a26580e9244cbda68531040e238209` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:46.773980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a26580e9244cbda68531040e238209)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:46.776554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:46.844497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a26580e9244cbda68531040e238209', 'request_id': 'req-f661a074-2997-4b8e-98af-a12225bcbb35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.851373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a26580e9244cbda68531040e238209', 'request_id': 'req-f661a074-2997-4b8e-98af-a12225bcbb35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.861176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a26580e9244cbda68531040e238209', 'request_id': 'req-f661a074-2997-4b8e-98af-a12225bcbb35'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.878906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] The token cache is being invalidate because project 43a26580e9244cbda68531040e238209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:46.879499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.880314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f661a074-2997-4b8e-98af-a12225bcbb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:46.882560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1008/2012] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:46 2022] DELETE /identity/v3/projects/43a26580e9244cbda68531040e238209 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:46.888376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:46.888659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:46.888933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:46.920267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:46.921499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.127461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1005/2013] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:47.137697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.138166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.138383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.143404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.145835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.160984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171dc4f-e778-4a7c-b540-d8e5f0d93622 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.176845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.177723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.178031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.178302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] PATH_INFO: `/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.181789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4c771a3bed43f5be3c4cc5fc118044)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.183758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.190613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:47.192620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.209851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1009/2014] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:47.211624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.223466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10828cf-4586-4d8e-be8b-cad737e257be None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.228834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.229599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.229976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.230318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.231122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:47.231491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.233176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.251485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1010/2015] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:47.252682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.274705 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf3c44-4357-4d0b-a81f-4dcc893c8a12 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.284112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.287716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.287716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.287716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.287716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.290294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.292861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:47.315000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:47.349691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4c771a3bed43f5be3c4cc5fc118044', 'request_id': 'req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:47.356928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1011/2016] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/projects => generated 359 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:47.357118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4c771a3bed43f5be3c4cc5fc118044', 'request_id': 'req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:47.358443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.365269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4c771a3bed43f5be3c4cc5fc118044', 'request_id': 'req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:47.391256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] The token cache is being invalidate because project eb4c771a3bed43f5be3c4cc5fc118044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:47.391610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:47.392440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8a458e0-5bfd-47f9-a80a-2c509eb73d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:47.394407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1006/2017] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:47 2022] DELETE /identity/v3/projects/eb4c771a3bed43f5be3c4cc5fc118044 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:47.400759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75169-2a57-4889-baad-a56c88306d54 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.401071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75169-2a57-4889-baad-a56c88306d54 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.401480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75169-2a57-4889-baad-a56c88306d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.429058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c6b75169-2a57-4889-baad-a56c88306d54 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:47.431230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c6b75169-2a57-4889-baad-a56c88306d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.463647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191a977-9e03-4cea-ba4b-14cf759402ee admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.469396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.470123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.470443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.470777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.472580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.474684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.503403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1012/2018] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/users => generated 280 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:47.508168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.510137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.518058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1007/2019] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:47.524512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.524665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.524892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.528073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0af32-3141-4708-87af-43ed625e8702 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.537039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.538044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.538428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.538807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.539648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.542241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.548938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:47.551148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.561106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1013/2020] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:47.561802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1008/2021] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:47.566438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.566740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.578490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a6fd-d5d6-4cd4-9777-f413960bdf65 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.580267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412428c9-a7c8-457f-9617-44b6e47cce65 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.584212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.585072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.585371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.585653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.586641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:47.586726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.590129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.590922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.591202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.591527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.592585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.592720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.594430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.609444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1009/2022] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:47.614466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.615901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1014/2023] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:47.619497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.626040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717b442-91c4-4f08-a313-6386da75ceb4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.631831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204509a-bb93-47d4-b042-fe6f3775071e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.633385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.634097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.634376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.634651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.635812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.637703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.640194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.641159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.641966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.641966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] PATH_INFO: `/v3/projects/bae80ed00f154b988d7713bdbe1af9e2/users/5bff6a1967ad464d8624de9c59061b04/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.672061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae80ed00f154b988d7713bdbe1af9e2, user_id=5bff6a1967ad464d8624de9c59061b04, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.674861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16106fa-4eb6-4e87-9d8e-c1de630d49fe admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.688427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1010/2024] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:47.693712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.697874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1015/2025] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:47 2022] PUT /identity/v3/projects/bae80ed00f154b988d7713bdbe1af9e2/users/5bff6a1967ad464d8624de9c59061b04/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:47.711534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.714243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.714668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.777378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] MFA Rules not processed for user `5bff6a1967ad464d8624de9c59061b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:47.778660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.799035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fba9-0c77-4173-b81a-a9b5a3d3f57b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:47.833701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:47.927779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:47.927961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1016/2026] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:47.928713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:47.929133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:47.929507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:47.930384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:47.932558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:47.966435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:47.968334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:47.973381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1011/2027] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:47 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:47.977596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.001582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709167d-fb04-4d5d-94d9-5260d6b5a2d5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.011632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.012320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.012604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.012998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.013601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.015242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.040105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1012/2028] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:48.045278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.046895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:48.064871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57155bf4-378d-41f4-84f0-4874e8862b72 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.078060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.078763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.079044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.079321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.084999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.086691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.113242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1013/2029] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:48.128610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.149420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea45c-6c91-4a0d-972b-d99915feda7a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.158573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.160092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.160513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.160821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] PATH_INFO: `/v3/projects/72b383e976a0467dbe84322e8cebd219/users/d76eea06e0e04981a180991bba50f085/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.162937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8b86-b5ae-4cf7-b6e8-bd2f7be93f3d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.174745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.176228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.176669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.178388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.182840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b383e976a0467dbe84322e8cebd219, user_id=d76eea06e0e04981a180991bba50f085, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.187048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3d326-4878-4b58-9bd1-f56f5ce7de32 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.197779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.201704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.204682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1014/2030] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:48 2022] PUT /identity/v3/projects/72b383e976a0467dbe84322e8cebd219/users/d76eea06e0e04981a180991bba50f085/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:48.219419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.219701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.219973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.230647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1017/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:47 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:48.245497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.261355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] MFA Rules not processed for user `d76eea06e0e04981a180991bba50f085`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:48.263250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:48.269688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151c7a6-d48d-45de-879a-f8c7ac0eb161 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.391859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.391859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.391859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.391859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] PATH_INFO: `/v3/users/5bff6a1967ad464d8624de9c59061b04` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.394002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bff6a1967ad464d8624de9c59061b04)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.396236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.420101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1015/2032] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:48.426100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.442314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1f98-95f5-4a4f-a166-3d59dc9e934e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.455670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.457392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.457683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.457979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.458736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.466269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.494035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bff6a1967ad464d8624de9c59061b04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:48.495774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bff6a1967ad464d8624de9c59061b04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:48.497503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bff6a1967ad464d8624de9c59061b04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:48.522405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bff6a1967ad464d8624de9c59061b04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:48.525503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1016/2033] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:48 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:48.538251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.540068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:48.540956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ff251b89-c3b6-4e5c-af3b-8f86b72e4c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bff6a1967ad464d8624de9c59061b04'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:48.562543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1018/2034] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:48 2022] DELETE /identity/v3/users/5bff6a1967ad464d8624de9c59061b04 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:48.567458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.567458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.567857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.593262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:48.609010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:48.610478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:48.639124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536ee5-cad5-4d42-baa2-3b1a63423b1b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.669599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:48.700892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1019/2035] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:48.712110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.713765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:48.719249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.719930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.720216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.720498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.721201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.723900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.748145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1017/2036] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:48 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:48.752441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.763112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a847-bde2-429b-b774-324000b21a31 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.768485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.770001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.770470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.770874 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.772682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.775739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.790711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f108c-b7f2-4f13-99f4-c7c46e96ada2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.790711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.790711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.790711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.791027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.802544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1018/2037] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:48.804371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.806394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.807847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.814913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a922b-56d3-4bae-8d81-b69c7445a930 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.819224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1020/2038] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:48.820707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:48.821848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.822174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.822447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] PATH_INFO: `/v3/projects/b09fba255d994c308ad4c43d12a46373/users/b7e160ec27084e2b82c6ba27adec02de/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.838310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09fba255d994c308ad4c43d12a46373, user_id=b7e160ec27084e2b82c6ba27adec02de, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:48.840994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c7348-7479-43de-b456-c51974b4a892 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:48.859118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1019/2039] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:48 2022] PUT /identity/v3/projects/b09fba255d994c308ad4c43d12a46373/users/b7e160ec27084e2b82c6ba27adec02de/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:48.864521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:48.879092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd38896-1e0e-4cf1-824a-5eb6f67d864d service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:48.884538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32bb2-f78a-425e-bed3-765f005a50bf None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.885172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32bb2-f78a-425e-bed3-765f005a50bf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.885931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32bb2-f78a-425e-bed3-765f005a50bf None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.887883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1020/2040] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 15:27:48.900184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:48.900748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:48.901611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:48.939631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:48.941931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.019814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.020504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.020859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.021065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.022440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.023767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.042172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1021/2041] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:49.042172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.043816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.052047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1021/2042] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:49.053207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.057628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405b52-4e97-4867-a30b-31ca66ecf2ea admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.062911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.063713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.063995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.064305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] PATH_INFO: `/v3/users/dfb1a8f4f6564510b9d4d3ca9f4362f9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.065189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f0c82-0805-4bc4-b38c-e34b1a6a4d54 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.065556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb1a8f4f6564510b9d4d3ca9f4362f9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.068698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.072033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.073807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.074297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.074727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] PATH_INFO: `/v3/projects/b09fba255d994c308ad4c43d12a46373/users/b7e160ec27084e2b82c6ba27adec02de/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.077150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09fba255d994c308ad4c43d12a46373, user_id=b7e160ec27084e2b82c6ba27adec02de, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.080280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.092481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1022/2043] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:49 2022] PUT /identity/v3/projects/b09fba255d994c308ad4c43d12a46373/users/b7e160ec27084e2b82c6ba27adec02de/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:49.093389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.096067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.124057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:49.131813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb1a8f4f6564510b9d4d3ca9f4362f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.132937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb1a8f4f6564510b9d4d3ca9f4362f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.133403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb1a8f4f6564510b9d4d3ca9f4362f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.147390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb1a8f4f6564510b9d4d3ca9f4362f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.154814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6a851420-6249-4c20-a442-e6a5254205b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb1a8f4f6564510b9d4d3ca9f4362f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.158807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:49.170783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1022/2044] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:49 2022] DELETE /identity/v3/users/dfb1a8f4f6564510b9d4d3ca9f4362f9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:49.176195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.176583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.176952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.191712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44320489-c5ed-4389-80b4-5f84689f31c2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.213949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] MFA Rules not processed for user `b7e160ec27084e2b82c6ba27adec02de`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:49.215373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.299560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1023/2045] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:49.300569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.301860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.313383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.314096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.314382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.314660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.316785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.328490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.330244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.341721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1023/2046] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:49.342518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.343911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.393584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c5f36-8f64-43c2-9179-b61dd8087ced None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.403124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.404793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.405267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.405746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] PATH_INFO: `/v3/projects/bae80ed00f154b988d7713bdbe1af9e2` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.407787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae80ed00f154b988d7713bdbe1af9e2)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.412068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.421769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42d6e4-6dbd-42ab-8cc6-0fb836bc84ab service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.428407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.429592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.430364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.430926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.447309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.450873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.467214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1024/2047] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:49.475670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae80ed00f154b988d7713bdbe1af9e2', 'request_id': 'req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.475838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.477792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.481682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae80ed00f154b988d7713bdbe1af9e2', 'request_id': 'req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.493743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae80ed00f154b988d7713bdbe1af9e2', 'request_id': 'req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.499354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc50e7b-d955-438f-9f22-f7f29e157867 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.505294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] The token cache is being invalidate because project bae80ed00f154b988d7713bdbe1af9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:49.505590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.506326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c59d0ae0-d4c2-470e-958b-bd3c03d95bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.507930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1024/2048] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:49 2022] DELETE /identity/v3/projects/bae80ed00f154b988d7713bdbe1af9e2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:49.513190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c7bd-bf5f-40f5-b0a7-24ea54d077bb None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.513553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c7bd-bf5f-40f5-b0a7-24ea54d077bb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.513944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c7bd-bf5f-40f5-b0a7-24ea54d077bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.543209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5093c7bd-bf5f-40f5-b0a7-24ea54d077bb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:49.544631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5093c7bd-bf5f-40f5-b0a7-24ea54d077bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.553410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:49.578160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:49.594110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.595332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.595615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.596207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] PATH_INFO: `/v3/projects/0bdc3492fd6d445080f99c7cb122ce5c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.598339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdc3492fd6d445080f99c7cb122ce5c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.600383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.669374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1025/2049] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:49.679716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.680343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.680682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.686676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdc3492fd6d445080f99c7cb122ce5c', 'request_id': 'req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.698826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdc3492fd6d445080f99c7cb122ce5c', 'request_id': 'req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.713271 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdc3492fd6d445080f99c7cb122ce5c', 'request_id': 'req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.718238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:49.722069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.745191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] The token cache is being invalidate because project 0bdc3492fd6d445080f99c7cb122ce5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:49.745625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.746607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8eb5d34a-cffc-4e2d-b9dd-a79e8747ddce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:49.748967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1025/2050] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:49 2022] DELETE /identity/v3/projects/0bdc3492fd6d445080f99c7cb122ce5c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:49.754184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adcb6-8f1b-42ad-836b-9b9669a23300 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.754468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adcb6-8f1b-42ad-836b-9b9669a23300 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.754760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adcb6-8f1b-42ad-836b-9b9669a23300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.776190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3f5adcb6-8f1b-42ad-836b-9b9669a23300 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:49.777388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f5adcb6-8f1b-42ad-836b-9b9669a23300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.799970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1026/2051] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:49.804555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.822509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dd75-1426-484d-8a4f-9f5d21d08139 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.829045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.829939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.830464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.830763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.832074 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:49.832388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.834267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.847215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1027/2052] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:27:49.855363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.871281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1026/2053] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:49.871471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e94ec-7370-454d-aa49-aead22fcdc72 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.874965 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:49.875130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.875390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.875761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:49.875867 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.876097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:49.876443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:49.877707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:49.880908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:49.906166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:49.907391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:49.915847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1027/2054] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:49.921683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.922449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1028/2055] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:49.923709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:49.931496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e28eb-2682-4504-be02-a3e32c4cbe8e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:49.999420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870280d6-a9ab-47ac-afaa-3dcfd9373bed admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.018118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.019175 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.019660 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.020151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.029951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.031170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.031849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.032138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.032416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.032813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.033433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:50.033860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.035824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.055546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1028/2056] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:27:50.060572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.099263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1029/2057] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:49 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:50.100360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.101963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b775-3d14-46b2-a51a-4c66c102b717 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.114671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a71f01-538d-4639-a9b7-dda01b3cdd94 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.120664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.121336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.121627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.121930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.122789 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.125036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.126771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.127512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.127800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.128151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.129602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.131364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.131950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.134676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.150627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1030/2058] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.157939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.172609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1029/2059] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:27:50.173577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.180080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf6c71-60ad-450d-b842-9f1fb619f1a4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.261644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.262360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.262640 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.262920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.263651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.265300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.277454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601a56-bd08-44c7-a4ce-3c17bd5e7580 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.280132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1031/2060] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.284923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.289046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.290014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.290309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.290826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.291658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.293638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.307099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9c3e-4e2d-43e5-b6a2-88e868d9cc95 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.311188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.312690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.312916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.313202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] PATH_INFO: `/v3/projects/531f98fbd01543ed92a4b08f692bc5cd/users/8d9811db5503488abff3151c481f76fd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.326305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1030/2061] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:50.328107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.339746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53bd8-305e-45c3-83a4-b227dd6ec96a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.339885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531f98fbd01543ed92a4b08f692bc5cd, user_id=8d9811db5503488abff3151c481f76fd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.343420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.344926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.346080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.346558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.347447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.348186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.349818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195ea7-d7df-475e-bfed-e8a0db32d4f2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.358613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1032/2062] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:50 2022] PUT /identity/v3/projects/531f98fbd01543ed92a4b08f692bc5cd/users/8d9811db5503488abff3151c481f76fd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:50.359487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.370591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.375998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1031/2063] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.375998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.375998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.375998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.410813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] MFA Rules not processed for user `8d9811db5503488abff3151c481f76fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:50.412294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.454375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c9cfa-a11a-41a9-8733-1fcd107a5fc5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.460101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.460996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.461562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.461669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] PATH_INFO: `/v3/users/d76eea06e0e04981a180991bba50f085` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.462900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76eea06e0e04981a180991bba50f085)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.465108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.489029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1032/2064] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:50.489654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.503266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a33d2-b4f9-47f7-b109-88c7dd9c2178 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.508365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.509053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.509323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.509598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.510363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.512030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.520440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76eea06e0e04981a180991bba50f085'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.521136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76eea06e0e04981a180991bba50f085'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.521796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76eea06e0e04981a180991bba50f085'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.523268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1033/2065] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.524011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.525671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.536309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76eea06e0e04981a180991bba50f085'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.539004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e89f55-c204-4ec3-8e55-09e5b9197f5c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.540731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.543402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76eea06e0e04981a180991bba50f085'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.543886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.544528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.544811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.545090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.545777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.547758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef9a4-e235-4324-ab1e-eb484fa8656f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.558901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1033/2066] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:50 2022] DELETE /identity/v3/users/d76eea06e0e04981a180991bba50f085 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:50.562591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.563943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.576768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1034/2067] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:50.578346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.578642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.578920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.598003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:50.599265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.616344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.632618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cadb2-7b37-439c-97ba-fb05c7757617 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.664078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1035/2068] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:50.664900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.678237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd48441-c85d-4f06-aeec-869bfb595271 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.683710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.684372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.684665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.684939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.685624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.687791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.694680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.695583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.695867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.696144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] PATH_INFO: `/v3/projects/5b7a421688ef461a8d7cd39f08649c9d/users/c1ca9d59132a4af797e257566d11d280/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.708814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1036/2069] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:50.709732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.712259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.714413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7a421688ef461a8d7cd39f08649c9d, user_id=c1ca9d59132a4af797e257566d11d280, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.717125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.733076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1034/2070] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:50 2022] PUT /identity/v3/projects/5b7a421688ef461a8d7cd39f08649c9d/users/c1ca9d59132a4af797e257566d11d280/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:50.733966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.782841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1533-6490-4b04-913a-09aa0ee8a2b0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.808875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db3865-4047-4fd7-993d-06222a98cc66 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.814226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.814927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.815214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.815492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.816801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.818452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec01cb-af3d-43c1-ac97-c06d173e748e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.828646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1035/2071] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.830047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.830215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.830333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.830605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.830860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.831160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.831452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.840596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.842038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.851632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1037/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:50.854062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.856578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.857604 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] MFA Rules not processed for user `c1ca9d59132a4af797e257566d11d280`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:50.858099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.860182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.873076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8babf-c13c-4e8d-91b6-2367ac56a79e service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.878853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.879722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.879999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.880270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] PATH_INFO: `/v3/users/d8272fc2ef884a7ba016465eb8042bd1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.881468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8272fc2ef884a7ba016465eb8042bd1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.883419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.937706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8272fc2ef884a7ba016465eb8042bd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.938476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8272fc2ef884a7ba016465eb8042bd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.939114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8272fc2ef884a7ba016465eb8042bd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.947880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8272fc2ef884a7ba016465eb8042bd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.948049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1036/2073] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:50.948867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.953547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:50.960562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c580d-cc5e-4bd1-9aaf-13b2246d8a9d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:50.964037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8272fc2ef884a7ba016465eb8042bd1'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:50.965624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:50.966370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:50.966704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:50.967097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:50.967859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:50.969539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:50.980528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1037/2074] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:50.984354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.986127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:50.994665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1038/2075] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:50 2022] DELETE /identity/v3/users/d8272fc2ef884a7ba016465eb8042bd1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:50.995817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:50.998019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.073262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868328b8-af07-48df-a6be-ca5d507de38c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.088251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5859a5-083f-49a6-8950-5300268c8883 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.094312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.095030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.095160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.095542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] PATH_INFO: `/v3/projects/e0d639d2839d4312ad90e90cb91395e6/users/68d80a9cfed24fe69336678635cb70ea/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.115626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d639d2839d4312ad90e90cb91395e6, user_id=68d80a9cfed24fe69336678635cb70ea, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.118645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2cc97-6c2c-4eef-9275-ee148415213a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.137291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1039/2076] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:50 2022] PUT /identity/v3/projects/e0d639d2839d4312ad90e90cb91395e6/users/68d80a9cfed24fe69336678635cb70ea/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:51.139975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e35b-36e2-4880-b0d1-6d29da4f4854 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.140622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e35b-36e2-4880-b0d1-6d29da4f4854 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.141406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e35b-36e2-4880-b0d1-6d29da4f4854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.161018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ac55e35b-36e2-4880-b0d1-6d29da4f4854 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:51.162268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac55e35b-36e2-4880-b0d1-6d29da4f4854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.166786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.168105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.168105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.168105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.170378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.201338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.230673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1040/2077] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:51.232077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.232435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.232784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.249431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.251073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.264039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] MFA Rules not processed for user `68d80a9cfed24fe69336678635cb70ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:51.267315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.267472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1038/2078] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:51.267472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.268057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.283932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba84cf-673b-4786-ad9e-d51f47080a89 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.289738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.290115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.290851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.291007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] PATH_INFO: `/v3/projects/72b383e976a0467dbe84322e8cebd219` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.292075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b383e976a0467dbe84322e8cebd219)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.294049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.351995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.373504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b383e976a0467dbe84322e8cebd219', 'request_id': 'req-39cc4c5c-fd98-4506-8167-b801067f04fc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.380139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b383e976a0467dbe84322e8cebd219', 'request_id': 'req-39cc4c5c-fd98-4506-8167-b801067f04fc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.386248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1041/2079] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:51.387598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.388731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.392578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b383e976a0467dbe84322e8cebd219', 'request_id': 'req-39cc4c5c-fd98-4506-8167-b801067f04fc'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.404878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] The token cache is being invalidate because project 72b383e976a0467dbe84322e8cebd219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:51.405349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.406061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.407863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1039/2080] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:51 2022] DELETE /identity/v3/projects/72b383e976a0467dbe84322e8cebd219 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:51.408414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.411998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.479797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65730c9a-ab7a-4005-9a82-fef4d366b18f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.517561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4c5c-fd98-4506-8167-b801067f04fc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.523501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.524268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.524620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.526550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.526550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.527674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.559628 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.560149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1040/2081] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:51 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:51.560474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.560752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.561034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.561282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.563288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.564529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.576535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.578038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.588276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1042/2082] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:51.589144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.591280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.603209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ddbb-fe28-4505-a976-de67389265fd service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.615599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.645464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c450c-91e7-49e4-a466-ba54fbd53e64 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.652801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.653679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.653998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.654281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] PATH_INFO: `/v3/users/b7e160ec27084e2b82c6ba27adec02de` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.655687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e160ec27084e2b82c6ba27adec02de)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.657622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.712819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e160ec27084e2b82c6ba27adec02de'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.713123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:51.714006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.714290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.714521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e160ec27084e2b82c6ba27adec02de'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.714640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] PATH_INFO: `/v3/users/c1ca9d59132a4af797e257566d11d280` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.715453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e160ec27084e2b82c6ba27adec02de'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.715835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ca9d59132a4af797e257566d11d280)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:51.718256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:51.731357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e160ec27084e2b82c6ba27adec02de'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.740343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e160ec27084e2b82c6ba27adec02de'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.768437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1041/2083] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:51 2022] DELETE /identity/v3/users/b7e160ec27084e2b82c6ba27adec02de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:51.769379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:51.772230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.802320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ca9d59132a4af797e257566d11d280'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.803502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ca9d59132a4af797e257566d11d280'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.804225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ca9d59132a4af797e257566d11d280'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.808356 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:51.819330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ca9d59132a4af797e257566d11d280'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.834473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5bea7d8c-0823-48de-89ab-74bdfd383f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ca9d59132a4af797e257566d11d280'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:51.865085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1043/2084] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:51 2022] DELETE /identity/v3/users/c1ca9d59132a4af797e257566d11d280 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:51.866883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:51.867626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:51.867985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:51.899101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:51.900463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:51.918768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406de7a-a52f-4f0f-be53-5c845816eda9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:51.999578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1044/2085] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:52.000301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.001676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.008418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.009357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.009707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.010082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.010877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.013014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.023883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:52.044065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1042/2086] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:51 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:52.045067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.046840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.059018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05397955-5a78-41a9-a1bd-4bf69a76e3bb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.064046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.065058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.065348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.066199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] PATH_INFO: `/v3/projects/10a6ddd5bb754f929b7f34b399c195c6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.067390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a6ddd5bb754f929b7f34b399c195c6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.069304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.074649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363da8c-0091-4ab7-bc91-5e5ebfb16f0e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.079093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.079747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.080026 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.080295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.082773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.134777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a6ddd5bb754f929b7f34b399c195c6', 'request_id': 'req-417dd938-1cfd-430a-a171-f5200da2e576'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.144900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a6ddd5bb754f929b7f34b399c195c6', 'request_id': 'req-417dd938-1cfd-430a-a171-f5200da2e576'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.153583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a6ddd5bb754f929b7f34b399c195c6', 'request_id': 'req-417dd938-1cfd-430a-a171-f5200da2e576'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.156565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.158057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.166826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] The token cache is being invalidate because project 10a6ddd5bb754f929b7f34b399c195c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:52.166939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.167800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.169602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1043/2087] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:52 2022] DELETE /identity/v3/projects/10a6ddd5bb754f929b7f34b399c195c6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:52.170566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1045/2088] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:52.172362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.173948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.174275 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.175591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.188415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e27d-05dd-4c5c-b6d5-e3338ebca9a3 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.202618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:52.241530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dd938-1cfd-430a-a171-f5200da2e576 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.245556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.246266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.246533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.246804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.248883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.254829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.255562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.255860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.256124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.257121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.258563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.263519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.269946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1046/2089] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:52.269946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.271930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.272037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cace1-fd08-4d43-9e2b-48e9d81b2455 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.285573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9df73-3878-4cd1-8b77-0f710fbb65c4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.289833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1044/2090] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:52.291171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.291463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.291812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.297009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.297884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.298208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.298501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] PATH_INFO: `/v3/projects/b09fba255d994c308ad4c43d12a46373` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.300459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09fba255d994c308ad4c43d12a46373)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.302402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.330024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:52.332076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.343041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1045/2091] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:52.344108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.345585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.360684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfa930-7e63-4291-bc5f-5b7c95e10108 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.365729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09fba255d994c308ad4c43d12a46373', 'request_id': 'req-ec49095f-91e3-4b0f-af66-a03a5ec1c583'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.377312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09fba255d994c308ad4c43d12a46373', 'request_id': 'req-ec49095f-91e3-4b0f-af66-a03a5ec1c583'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.389198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09fba255d994c308ad4c43d12a46373', 'request_id': 'req-ec49095f-91e3-4b0f-af66-a03a5ec1c583'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.414079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] The token cache is being invalidate because project b09fba255d994c308ad4c43d12a46373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:52.414412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.415246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ec49095f-91e3-4b0f-af66-a03a5ec1c583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.416990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1047/2092] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:52 2022] DELETE /identity/v3/projects/b09fba255d994c308ad4c43d12a46373 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:52.418581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814b44-4adc-4849-a9a5-d10fb0aad8f2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.418866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814b44-4adc-4849-a9a5-d10fb0aad8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.419138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9814b44-4adc-4849-a9a5-d10fb0aad8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.452798 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.453978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.454258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.454527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] PATH_INFO: `/v3/projects/e74e22745fef43c6aa94e5e06cd0b756/users/2af0f1ee4d914055b9ad7ce2ed4440d3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.466797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c9814b44-4adc-4849-a9a5-d10fb0aad8f2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:52.468821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c9814b44-4adc-4849-a9a5-d10fb0aad8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.472727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74e22745fef43c6aa94e5e06cd0b756, user_id=2af0f1ee4d914055b9ad7ce2ed4440d3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.478658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.480937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1048/2093] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:52.483421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.484117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.484505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.485529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:52.508561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1046/2094] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:52 2022] PUT /identity/v3/projects/e74e22745fef43c6aa94e5e06cd0b756/users/2af0f1ee4d914055b9ad7ce2ed4440d3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:52.512334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.514087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:52.515337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.615707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330d345-edec-4390-a267-031dcbda3f0b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.619553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1049/2095] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:52.620531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.621925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.635143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.636870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.637181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.637463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.639975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:52.639975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.642936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1709e4-b36c-40d0-a1d3-6791aa0f78fc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.648022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ce50a-7e0b-4fd2-b2df-2f1faa1370e3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.653814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.654633 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.654932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.655298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.656065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.657808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.659913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1047/2096] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:52.661357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.661658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.661955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.677951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1050/2097] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:52.677951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.686070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728ea8-d448-41cd-aff9-1a3cde0a9a56 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.688735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:52.690349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.692513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.693444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.693764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.694138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.694902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.696990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.703443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1048/2098] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:52.704422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.707578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.721402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e505175-2440-494b-b1fd-0f6826079d79 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.722301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:52.728949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.730027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.730273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.730679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] PATH_INFO: `/v3/projects/5b7a421688ef461a8d7cd39f08649c9d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.731803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7a421688ef461a8d7cd39f08649c9d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.733237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1051/2099] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:52.734536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.737619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.794885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7a421688ef461a8d7cd39f08649c9d', 'request_id': 'req-c06ed8db-4691-4385-8507-b9c787153b1d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.800778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7a421688ef461a8d7cd39f08649c9d', 'request_id': 'req-c06ed8db-4691-4385-8507-b9c787153b1d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.806812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5a4dd-dde5-4af9-b39c-fee9b2e33d68 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.808703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7a421688ef461a8d7cd39f08649c9d', 'request_id': 'req-c06ed8db-4691-4385-8507-b9c787153b1d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.820580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] The token cache is being invalidate because project 5b7a421688ef461a8d7cd39f08649c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:52.820804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.821585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:52.823431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1049/2100] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:52 2022] DELETE /identity/v3/projects/5b7a421688ef461a8d7cd39f08649c9d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:52.824185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.825502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.883769 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.885240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.885542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.886031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] PATH_INFO: `/v3/projects/e74e22745fef43c6aa94e5e06cd0b756/users/2af0f1ee4d914055b9ad7ce2ed4440d3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.888054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74e22745fef43c6aa94e5e06cd0b756, user_id=2af0f1ee4d914055b9ad7ce2ed4440d3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.890876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.899976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed8db-4691-4385-8507-b9c787153b1d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.902401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1052/2101] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:52 2022] PUT /identity/v3/projects/e74e22745fef43c6aa94e5e06cd0b756/users/2af0f1ee4d914055b9ad7ce2ed4440d3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:52.911697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:52.911697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:52.911896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:52.973072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303cd12-1521-4c56-923e-32b38fb439b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:52.978536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.979211 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.979495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.979766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.980456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.982435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc5b40-9881-445e-8ead-9eebd35c8607 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:52.984100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:52.984772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:52.985056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:52.985369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:52.986116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:52.986421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:52.988034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e365ed-9a10-41d0-a1c5-e0d2cfcfc2c0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.002588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1050/2102] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:53.003909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.004196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.004468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.008815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1053/2103] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:52 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:53.010088 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d179c0-012b-4c22-a9b7-bf735b236357 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.010588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d179c0-012b-4c22-a9b7-bf735b236357 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.010877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d179c0-012b-4c22-a9b7-bf735b236357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.031672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.033042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.042917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1051/2104] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:53.043584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.050405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e3d179c0-012b-4c22-a9b7-bf735b236357 None None] MFA Rules not processed for user `2af0f1ee4d914055b9ad7ce2ed4440d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.051712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e3d179c0-012b-4c22-a9b7-bf735b236357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.053113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f12e-40bb-4856-bab6-1fde6e145a1c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.057960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.058614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.058889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.059158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.060007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.062020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.069712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:53.093103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1052/2105] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:53.094130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.139458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1054/2106] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:53.145707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.146089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.146373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.164620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183c326-4ecc-4379-a904-3c0c4ea955c9 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.166556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.167863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.170177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.170998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.171118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.171373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.172088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.173867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.178040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1055/2107] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:53.181967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.189091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebebc09-59e3-43fd-bc23-da7973257b1d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.189974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1053/2108] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.191308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.192957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.194923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.195609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.195896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.196177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.197223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.198825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.224559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1056/2109] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:53.224559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.234511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23adc8d-6b36-4aa9-bdd4-d6a8214308ed admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.239754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.240433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.240721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.241027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.241779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:53.242114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.243710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.259238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1057/2110] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:53.259402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43d64-19a8-456b-b256-ccdf8cc742cb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.259834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.259945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.260556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.260841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.261119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.263107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.266002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a1af2-12a4-4a82-b372-5ea598fc856d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.271065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.271690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.271969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.272245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.272951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.274547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.285585 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1058/2111] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.286793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.292804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:53.300260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05815-85d3-4029-b553-f84a0d8f274f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.309667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.310576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.310869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.311152 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.311886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.313503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.327373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1059/2112] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.327373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.329879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.331898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.335163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e0fa-0bea-4570-8dd6-4836d6af74f8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.339919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.340566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.340850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.341138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.341296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1054/2113] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:53.341818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.342181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.343824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.356322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c886-37f8-4f48-9be1-19d3c5da7215 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.360933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.361816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.362129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.362404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] PATH_INFO: `/v3/projects/8fb58ed8e6534e3d917244da26236a1f/users/e18c00c7d6234928b870ecc419259666/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.374373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1060/2114] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:53.378482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.379390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb58ed8e6534e3d917244da26236a1f, user_id=e18c00c7d6234928b870ecc419259666, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.382121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.397509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1055/2115] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:53 2022] PUT /identity/v3/projects/8fb58ed8e6534e3d917244da26236a1f/users/e18c00c7d6234928b870ecc419259666/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:53.398547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.443604 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bfed2-771f-46c9-8338-25d85156bc17 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.470962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22216239-54e0-4ad9-aa45-7b2f6a077aea admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.475681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.476429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.476710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.476985 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.477668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.479617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb3fba-d3ec-46db-8038-88f44fc57d47 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.490849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:53.507895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1056/2116] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:53.507895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.507895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.507895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.519250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.519994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.520303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.520537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.521609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.523256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.529438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.531535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.533683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1061/2117] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.534578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.544944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe24e-6825-44bf-80c6-67ecf5a8b1ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.545493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1057/2118] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:53.546443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.553420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.554000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.554280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.554552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.555277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.556875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.564987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6fb9-bf22-41cf-a608-5a6b3c18b451 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.571301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1062/2119] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.572289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.572569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.573270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.573781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.574395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] PATH_INFO: `/v3/projects/824a78bab41944e982d193fbbd884329/users/ff67081954c24789b2adbfda059048d9/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.574969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.591787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=824a78bab41944e982d193fbbd884329, user_id=ff67081954c24789b2adbfda059048d9, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.594545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.615790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1058/2120] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:53 2022] PUT /identity/v3/projects/824a78bab41944e982d193fbbd884329/users/ff67081954c24789b2adbfda059048d9/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:53.616747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.658660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd682d1-0ec4-4a06-b109-28fd07003d5c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.718361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e1b4-b8d6-48d0-ac9e-cdf69194ebbf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.725508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.728285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.728586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.728916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.730364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.732000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02e58b-b639-4017-a5a5-e74e3fc6643f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.734266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.735140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.736028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.736028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.736937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:53.749218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.751203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.755587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1059/2121] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:53.757385 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.757807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.758858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.775089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1063/2122] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:53.778333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.789035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dd58-2809-4874-8613-e8bd65f37cf0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.792710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] MFA Rules not processed for user `ff67081954c24789b2adbfda059048d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.794427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.797179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:53.801065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.801591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.802091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] PATH_INFO: `/v3/projects/1808f15b994c4d43a238ce5f4ae0ef32/users/c6839407289b4b05a45bfa8f90c3e2e6/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.836076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1808f15b994c4d43a238ce5f4ae0ef32, user_id=c6839407289b4b05a45bfa8f90c3e2e6, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:53.839192 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414511a-664a-4ce9-b9ce-56fb45407e64 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:53.856840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1064/2123] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:53 2022] PUT /identity/v3/projects/1808f15b994c4d43a238ce5f4ae0ef32/users/c6839407289b4b05a45bfa8f90c3e2e6/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:53.869388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:53.869745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:53.870065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:53.873993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1060/2124] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:53.890297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:53.912175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] MFA Rules not processed for user `c6839407289b4b05a45bfa8f90c3e2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:53.913562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:53.963742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351118e-c78d-413a-91e4-f464bfc119c4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:53.967926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:53.991131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1065/2125] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:53.995857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.037599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.038390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.038821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.039193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.076008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9a4f-7ceb-43eb-848f-1a10ef7b229f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.081754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.082572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.082997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.083266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.084052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.086160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.119846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.121725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.126268 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:54.135440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1061/2126] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:54.136856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.138428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1066/2127] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:54.149378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f9c-be35-4bd1-bd51-e8c554333dee service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.162541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.238309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.239303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.239746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.240193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.241092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.241296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c34c9-158f-4b80-9da9-a8248d6ca0ac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.243861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.246365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.247323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.247673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.248016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] PATH_INFO: `/v3/users/ff67081954c24789b2adbfda059048d9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.249624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff67081954c24789b2adbfda059048d9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.251658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.271122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1062/2128] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:54 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:54.272321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.284928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d3e3-bb12-482c-955b-2afd5f7a81cf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.290709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.291658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.291986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.292226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.292960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.294616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.313562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1063/2129] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:54.314754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.323930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff67081954c24789b2adbfda059048d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:54.324686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff67081954c24789b2adbfda059048d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:54.325393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff67081954c24789b2adbfda059048d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:54.327005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226143-cb27-439c-93d9-25e6df3752a1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.333521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff67081954c24789b2adbfda059048d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:54.334717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.336351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.336351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.336741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] PATH_INFO: `/v3/projects/d19ab4fb52d8463bb54d014697953ae8/users/8f4316011ce74221a5f471616b73fdf3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.342105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e10ecbd4-981d-4489-b47b-9ec84348aae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff67081954c24789b2adbfda059048d9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:54.353920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:54.359932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19ab4fb52d8463bb54d014697953ae8, user_id=8f4316011ce74221a5f471616b73fdf3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.363602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.371688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1067/2130] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:54 2022] DELETE /identity/v3/users/ff67081954c24789b2adbfda059048d9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:54.373964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.374367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.374737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.385436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1064/2131] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:54 2022] PUT /identity/v3/projects/d19ab4fb52d8463bb54d014697953ae8/users/8f4316011ce74221a5f471616b73fdf3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:54.387060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.388871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.393716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:54.394930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.463697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d679ea-1d01-4ce8-b29c-6f7a01c0c721 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.466154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1068/2132] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:54.468347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.469020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.469302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.469642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.470321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.472625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.479685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.481321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.485941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1065/2133] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:54.487250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.497889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22ab4b-c162-4ac7-bbd6-80f463ef6be3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.503716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.504603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.504956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.505165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] PATH_INFO: `/v3/projects/d19ab4fb52d8463bb54d014697953ae8/users/8f4316011ce74221a5f471616b73fdf3/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.507366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19ab4fb52d8463bb54d014697953ae8, user_id=8f4316011ce74221a5f471616b73fdf3, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.510211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1b317-3ecf-4ccb-8d84-1bb9bc0c41a8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.542457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1066/2134] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:54 2022] PUT /identity/v3/projects/d19ab4fb52d8463bb54d014697953ae8/users/8f4316011ce74221a5f471616b73fdf3/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:54.552005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefa30-18c2-414f-a1f7-db2585d45e06 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.552293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefa30-18c2-414f-a1f7-db2585d45e06 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.552593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefa30-18c2-414f-a1f7-db2585d45e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.578671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6b73-be65-47cf-b2d3-e423964dbf0c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.589406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-7deefa30-18c2-414f-a1f7-db2585d45e06 None None] MFA Rules not processed for user `8f4316011ce74221a5f471616b73fdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:54.590692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-7deefa30-18c2-414f-a1f7-db2585d45e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.615100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:54.636209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.636893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.637170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.637437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.672696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1067/2135] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:54.680619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.680619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.680864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.708818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] MFA Rules not processed for user `e18c00c7d6234928b870ecc419259666`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:54.710160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.713289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.715498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.723797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:54.735456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1069/2136] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:27:54.737105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.747459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.823961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1068/2137] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:54.847895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9323-48dd-43d7-8a0d-48690ba636ab service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.853762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.854463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.854748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.855137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.867378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.868761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.881324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1070/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:54.896676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:54.898589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:54.918162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5953d7f-c60f-43a0-90de-e598d3a289d4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:54.924352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:54.926169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:54.926675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:54.927160 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:54.942487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:54.945494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:54.966150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1069/2139] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:55.083680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.094964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9aa4a-2bb0-4ac9-8c51-8c6fd6e706fc service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.101162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.102403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.102689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.102966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.105175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.205357 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.206850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.207809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e7376-c287-4317-8820-1195bac71883 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.208452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.231991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2afc-4b41-4ee1-a33a-65b71fd6a22d service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.239751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.240675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.241023 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.241222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] PATH_INFO: `/v3/projects/824a78bab41944e982d193fbbd884329` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.242635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824a78bab41944e982d193fbbd884329)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.244283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1071/2140] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:55.245124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.330155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824a78bab41944e982d193fbbd884329', 'request_id': 'req-a041331d-c068-4b49-826a-3f0a395083a4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.352535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824a78bab41944e982d193fbbd884329', 'request_id': 'req-a041331d-c068-4b49-826a-3f0a395083a4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.370982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824a78bab41944e982d193fbbd884329', 'request_id': 'req-a041331d-c068-4b49-826a-3f0a395083a4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.400776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] The token cache is being invalidate because project 824a78bab41944e982d193fbbd884329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:55.400776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.400776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a041331d-c068-4b49-826a-3f0a395083a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.400776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1070/2141] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:55 2022] DELETE /identity/v3/projects/824a78bab41944e982d193fbbd884329 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:55.404878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.405398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.406341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.441297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:55.445349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.590577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1072/2142] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:55.600195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.602954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.603409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.636073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:55.639691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.654871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1071/2143] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:55.657656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.672476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc2a87-854a-44f0-b031-5570ef7e4e67 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.679256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.679735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.680166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.680444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.681469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:55.681827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.684723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.717550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1073/2144] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:27:55.718690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.731529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a89b4-43ad-4774-8a00-85b00bcca200 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.736775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.738153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.738358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.738998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.742408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.742408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.753794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:55.781413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1072/2145] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:55 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:55.782451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.793285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4433ba-6fdb-41ea-903f-1f0c0fa8bb99 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.816390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.818557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.828563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:55.868974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.869887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.870330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.870704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.871545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.874004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.899634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1074/2146] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:55 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:55.900656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.901330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb0f6c-fafb-4e9e-97da-84bb713dcd80 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.905998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.906873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.907147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.907413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] PATH_INFO: `/v3/users/c6839407289b4b05a45bfa8f90c3e2e6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.908615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6839407289b4b05a45bfa8f90c3e2e6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.911121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.912915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf90b-497d-40d2-ad25-544c2cfa521a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.918117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.918654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.923943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.923943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.923943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.923943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.935641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1075/2147] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:55.939960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.951888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842938-5521-4802-a6a6-c3c956298252 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:55.957432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:55.958154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:55.958562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:55.958832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:55.959551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:55.961132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:55.969079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6839407289b4b05a45bfa8f90c3e2e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.970078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6839407289b4b05a45bfa8f90c3e2e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.970793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6839407289b4b05a45bfa8f90c3e2e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.973933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1076/2148] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:55.977974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:55.980170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:55.986059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6839407289b4b05a45bfa8f90c3e2e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.993058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9111b88b-6f68-4874-b5d0-dd22ca6ed563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6839407289b4b05a45bfa8f90c3e2e6'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:55.994408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e7e-4f28-4960-8e11-fafb67bf6259 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:56.001020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:56.002243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.002515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.003060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] PATH_INFO: `/v3/projects/6bcea71b75474df4bf08c33b6f7d813a/users/c61d758271a44ee5acd682f175217506/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.008589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1073/2149] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:55 2022] DELETE /identity/v3/users/c6839407289b4b05a45bfa8f90c3e2e6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:56.012751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.013338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.013628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.019775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcea71b75474df4bf08c33b6f7d813a, user_id=c61d758271a44ee5acd682f175217506, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:56.023039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391618a-8b9d-463d-99e8-233e2727b97c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:56.038554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1077/2150] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:55 2022] PUT /identity/v3/projects/6bcea71b75474df4bf08c33b6f7d813a/users/c61d758271a44ee5acd682f175217506/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:27:56.044442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.044801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.045145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.046191 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:56.051867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.065610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:56.067240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.150500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1078/2151] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:56.150500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:56.150500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.151802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1074/2152] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:27:56.162120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:56.164931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.182460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:56.220195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976bad-3f2f-4686-b4e1-3dbc34c97eb5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:56.224950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:56.225675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.226079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.226419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.228651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.239973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd3609-fe68-4c37-8c99-80ba05d83067 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:56.244832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:56.245732 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.246449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.246735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.259813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:56.261147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:56.262180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:56.273090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1075/2153] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:56.274063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:56.294288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa9744-4014-49b1-b4e3-7c749d84750c service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:56.298846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:56.299635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.300036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.318880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.318968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:56.318968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d3003-e4a7-4e11-ba89-29650a768a77 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:56.323786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:56.325309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:56.327354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1079/2154] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:56.343702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1076/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:27:56.469283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.469836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.470092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.489079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] MFA Rules not processed for user `e18c00c7d6234928b870ecc419259666`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:56.490501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.558374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1080/2156] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:56.926919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:56.928521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:56.943740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8da25-a52e-4881-8ef0-801d474166a6 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:56.951058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:56.951992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:56.952840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:56.953461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] PATH_INFO: `/v3/projects/1808f15b994c4d43a238ce5f4ae0ef32` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:56.955086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1808f15b994c4d43a238ce5f4ae0ef32)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:56.971209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:57.071560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1808f15b994c4d43a238ce5f4ae0ef32', 'request_id': 'req-12c47b0a-c92f-4b82-bdad-065d015eff55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.081371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1808f15b994c4d43a238ce5f4ae0ef32', 'request_id': 'req-12c47b0a-c92f-4b82-bdad-065d015eff55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.093819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1808f15b994c4d43a238ce5f4ae0ef32', 'request_id': 'req-12c47b0a-c92f-4b82-bdad-065d015eff55'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.109482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] The token cache is being invalidate because project 1808f15b994c4d43a238ce5f4ae0ef32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:57.109859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.110623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.113517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1077/2157] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:56 2022] DELETE /identity/v3/projects/1808f15b994c4d43a238ce5f4ae0ef32 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:57.124023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:57.136931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1cdd3-9206-4c4a-bced-3a2a603d2e2d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:57.252124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:57.254584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:57.254980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:57.255888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] PATH_INFO: `/v3/users/8f4316011ce74221a5f471616b73fdf3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:57.257670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4316011ce74221a5f471616b73fdf3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:57.263295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:57.366584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4316011ce74221a5f471616b73fdf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.367535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4316011ce74221a5f471616b73fdf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.368164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4316011ce74221a5f471616b73fdf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.382701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4316011ce74221a5f471616b73fdf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.399058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bde1f3b6-08a7-4ae3-a38b-01e1d659398a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4316011ce74221a5f471616b73fdf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:57.411257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:57.441933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1081/2158] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:27:57 2022] DELETE /identity/v3/users/8f4316011ce74221a5f471616b73fdf3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:57.932770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:57.934484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:57.959702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c47b0a-c92f-4b82-bdad-065d015eff55 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.080598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.082098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.082387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.082661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] PATH_INFO: `/v3/projects/d19ab4fb52d8463bb54d014697953ae8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.088746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19ab4fb52d8463bb54d014697953ae8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.091891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.154154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:58.197777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19ab4fb52d8463bb54d014697953ae8', 'request_id': 'req-fc2e53bf-0c12-4782-8459-eaffef29ee00'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:58.218014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19ab4fb52d8463bb54d014697953ae8', 'request_id': 'req-fc2e53bf-0c12-4782-8459-eaffef29ee00'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:58.235780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19ab4fb52d8463bb54d014697953ae8', 'request_id': 'req-fc2e53bf-0c12-4782-8459-eaffef29ee00'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:58.278746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] The token cache is being invalidate because project d19ab4fb52d8463bb54d014697953ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:27:58.279113 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:58.279950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc2e53bf-0c12-4782-8459-eaffef29ee00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:27:58.287637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1078/2159] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:27:57 2022] DELETE /identity/v3/projects/d19ab4fb52d8463bb54d014697953ae8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:58.289431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.290325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.290760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.348309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:58.349718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:58.426535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1082/2160] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:58.434503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.434843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.435233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.486622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:58.488627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:58.504086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1079/2161] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:58.508700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.519659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6211e1e-e8d3-408e-9378-20ec5d3ec0ce None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.548384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.549273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.549804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.550234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.550845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:27:58.551209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.552792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.569943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1083/2162] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:27:58.574691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.587003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b34cc-3f03-473d-ac17-ced015211319 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.594926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.595879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.596068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.596342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.597259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.599445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.633666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1080/2163] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:58 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:58.638031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.649959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c730faa-3a6e-4dee-8c98-7befccf698f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.810745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.811533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.811881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.812224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.813044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.815144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.850024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1084/2164] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:58 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:58.851610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.874278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d29a9-1c4a-45fd-a8d7-3c3cd4635c84 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.880121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.880900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.881250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.881596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.883031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.884919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.902143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1081/2165] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:27:58.903906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.917609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e02c-cca2-464c-984d-9f9e37e435ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.922968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.923656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.923950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.924303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:58.925689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:58.929272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa683db7-bd85-470d-a6b2-bce5800eebf0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:58.941951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1085/2166] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:58.945939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:58.961996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba7e41-444c-4898-b311-0751dccceb56 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:58.971398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:58.973138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:58.973241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:58.973525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] PATH_INFO: `/v3/projects/2e5a85ecc25a466e9511767b4cd01c46/users/c2e4bd933b924e9d8fcf2416c1f0679d/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.008417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5a85ecc25a466e9511767b4cd01c46, user_id=c2e4bd933b924e9d8fcf2416c1f0679d, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:59.015010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:59.058350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1082/2167] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:58 2022] PUT /identity/v3/projects/2e5a85ecc25a466e9511767b4cd01c46/users/c2e4bd933b924e9d8fcf2416c1f0679d/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:59.060781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:59.061434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:59.061746 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.121979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] MFA Rules not processed for user `c2e4bd933b924e9d8fcf2416c1f0679d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:27:59.124387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:27:59.180587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:27:59.229169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1086/2168] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:27:59.229884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:59.375841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8052d-b5f2-4ded-b241-b33feff96153 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:59.381714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:59.382521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:59.382880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:59.383309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.384082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:59.386108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:59.436833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1083/2169] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:27:59 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:59.441266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:59.454661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d5500-2436-48b5-92ed-dca76add29ae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:59.591879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:59.595007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:59.595865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:59.596958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.598898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:59.605072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:59.645124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1087/2170] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:27:59 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:27:59.649480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:59.666161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3127baf-f187-4196-b596-04b0b24601f5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:59.681709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:59.682423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:59.682714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:59.682993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.683919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:59.693962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:59.722740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1084/2171] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:27:59.726696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:59.743728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146802-113e-4bb0-a9c6-753c31cad985 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:59.754019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:27:59.755809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:27:59.755809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:27:59.755994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] PATH_INFO: `/v3/projects/ea526d10b4004e5cbed2409b247a6eca/users/f22591a7b75a44eca6b6d7ba41f4cfda/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:27:59.801069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea526d10b4004e5cbed2409b247a6eca, user_id=f22591a7b75a44eca6b6d7ba41f4cfda, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:27:59.804428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:27:59.858606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1088/2172] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:27:59 2022] PUT /identity/v3/projects/ea526d10b4004e5cbed2409b247a6eca/users/f22591a7b75a44eca6b6d7ba41f4cfda/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:27:59.861982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:27:59.879283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf91466-6e1e-4348-b0b9-28d26124e472 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:27:59.929024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:00.043844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:00.044699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.045453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.045887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.046672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:00.048299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3512cb3-36a9-4eb0-90f6-fbe29be7a17e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:00.074514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:00.076248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1085/2173] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:00.092532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254fad6-d73d-4b14-9e2c-4c3bcf0b06da admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:00.134298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:00.136350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.139750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.140265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] PATH_INFO: `/v3/projects/ea526d10b4004e5cbed2409b247a6eca/users/f22591a7b75a44eca6b6d7ba41f4cfda/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.144830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea526d10b4004e5cbed2409b247a6eca, user_id=f22591a7b75a44eca6b6d7ba41f4cfda, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:00.149612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:00.194266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1089/2174] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:00 2022] PUT /identity/v3/projects/ea526d10b4004e5cbed2409b247a6eca/users/f22591a7b75a44eca6b6d7ba41f4cfda/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:00.207200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.207889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.209095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.261859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] MFA Rules not processed for user `f22591a7b75a44eca6b6d7ba41f4cfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:00.263757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:00.368664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1086/2175] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:00.381296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:00.383227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:00.504621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ecfc9-63a3-4dcd-a719-080b6827ffb5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:00.510080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:00.510912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.511311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.511680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.523220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:00.525028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:00.548392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1090/2176] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:00.645537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:00.646992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:00.657815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:00.659522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:00.663833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade07f8-2e60-4283-a97e-464c93de7ce3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:00.670105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:00.670833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.671332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.671696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.718102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:00.748940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8d6bf-8c60-42d6-b9ae-3dc8215c38f6 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:00.755198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:00.755468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:00.756634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.756926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.757162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4506f4-c2eb-464c-b03c-1537e388ca13 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:00.757277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] PATH_INFO: `/v3/users/8d9811db5503488abff3151c481f76fd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.758457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9811db5503488abff3151c481f76fd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:00.760403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:00.777334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1087/2177] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:00.818205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9811db5503488abff3151c481f76fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:00.819043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9811db5503488abff3151c481f76fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:00.819805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9811db5503488abff3151c481f76fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:00.829625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9811db5503488abff3151c481f76fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:00.842109 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9811db5503488abff3151c481f76fd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:00.874988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1091/2178] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:00 2022] DELETE /identity/v3/users/8d9811db5503488abff3151c481f76fd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:00.876217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:00.876511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:00.876826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:00.897357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:00.898771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:00.946860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:00.974518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1088/2179] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:00.988410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:01.001342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:01.128021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8573-7e2f-4be5-9d18-cae00b315638 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:01.132575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:01.133378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:01.133666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:01.134141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:01.148510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:01.151055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:01.166876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1092/2180] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:01.908492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:01.911195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:01.933216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4ed7-567f-415f-8e33-812a4e9c3a01 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:01.961034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:01.962757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:01.963276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:01.963773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] PATH_INFO: `/v3/projects/531f98fbd01543ed92a4b08f692bc5cd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:01.965274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] RBAC: Authorizing `identity:delete_project(project_id=531f98fbd01543ed92a4b08f692bc5cd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:01.968516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:02.049487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531f98fbd01543ed92a4b08f692bc5cd', 'request_id': 'req-ba8242e2-7796-42a7-97e5-f6759b09452f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.058781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531f98fbd01543ed92a4b08f692bc5cd', 'request_id': 'req-ba8242e2-7796-42a7-97e5-f6759b09452f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.067399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531f98fbd01543ed92a4b08f692bc5cd', 'request_id': 'req-ba8242e2-7796-42a7-97e5-f6759b09452f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.082565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] The token cache is being invalidate because project 531f98fbd01543ed92a4b08f692bc5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:02.082848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.084247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.085777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1089/2181] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:01 2022] DELETE /identity/v3/projects/531f98fbd01543ed92a4b08f692bc5cd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:02.089492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:02.100881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d26c0-f974-4b0c-adfc-b12c9750a3e4 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:02.170395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:02.171008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:02.171291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:02.171569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] PATH_INFO: `/v3/users/68d80a9cfed24fe69336678635cb70ea` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:02.177971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d80a9cfed24fe69336678635cb70ea)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:02.177971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:02.177971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:02.239248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d80a9cfed24fe69336678635cb70ea'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.239901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d80a9cfed24fe69336678635cb70ea'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.240513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d80a9cfed24fe69336678635cb70ea'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.248067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d80a9cfed24fe69336678635cb70ea'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.256873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-99463d2c-739b-464c-874b-5b6ed77dfe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d80a9cfed24fe69336678635cb70ea'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:02.280853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1093/2182] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:02 2022] DELETE /identity/v3/users/68d80a9cfed24fe69336678635cb70ea => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:02.723083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:02.724700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:02.757784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8242e2-7796-42a7-97e5-f6759b09452f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:02.974782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:02.975678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:02.976062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:02.976518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] PATH_INFO: `/v3/projects/e0d639d2839d4312ad90e90cb91395e6` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:02.978971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d639d2839d4312ad90e90cb91395e6)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:02.981227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.194606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.195527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.195978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.200883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d639d2839d4312ad90e90cb91395e6', 'request_id': 'req-5b2ad993-30b9-4d99-a0af-0e92471ec587'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.216260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d639d2839d4312ad90e90cb91395e6', 'request_id': 'req-5b2ad993-30b9-4d99-a0af-0e92471ec587'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.237813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d639d2839d4312ad90e90cb91395e6', 'request_id': 'req-5b2ad993-30b9-4d99-a0af-0e92471ec587'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.250790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] MFA Rules not processed for user `c61d758271a44ee5acd682f175217506`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:03.256590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:03.266921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:03.272514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] The token cache is being invalidate because project e0d639d2839d4312ad90e90cb91395e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:03.273043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.273877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.276180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1090/2183] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:02 2022] DELETE /identity/v3/projects/e0d639d2839d4312ad90e90cb91395e6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:03.279751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.281977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:03.376611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1094/2184] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:03.381559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.382982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:03.396073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad993-30b9-4d99-a0af-0e92471ec587 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.397998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6219aa-0b47-472b-b9af-c0bf585d7e61 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.401858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.403104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.403489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.403672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.404079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] PATH_INFO: `/v3/users/2af0f1ee4d914055b9ad7ce2ed4440d3` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.404231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.404772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.405051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.405747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af0f1ee4d914055b9ad7ce2ed4440d3)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.406018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.408080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.408572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.449494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1095/2185] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:03 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:03.457156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.505628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af0f1ee4d914055b9ad7ce2ed4440d3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.508378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af0f1ee4d914055b9ad7ce2ed4440d3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.509532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af0f1ee4d914055b9ad7ce2ed4440d3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.536121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af0f1ee4d914055b9ad7ce2ed4440d3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.551127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af0f1ee4d914055b9ad7ce2ed4440d3'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:03.571687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:03.586522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1091/2186] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:03 2022] DELETE /identity/v3/users/2af0f1ee4d914055b9ad7ce2ed4440d3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:03.598734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d03a0-fd62-41cf-b7e3-521de9ef9ad8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.685216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.686254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.686567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.686852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.687543 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.689501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.723860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1096/2187] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:03 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:03.725049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.729765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:03.745804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7634d-bc32-4c02-89ae-49718df71268 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.751751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.752691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.752979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.753255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.754164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.756743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.773138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1092/2188] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:03.778886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.793750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd22-e1e6-4351-b443-a0bad4cb40a3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.799738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.800645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.800924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.801242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] PATH_INFO: `/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757/users/bc6a4e199fa640f08a32be232914748b/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.819064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28b36dbcbc44bf2a63c483eab7f4757, user_id=bc6a4e199fa640f08a32be232914748b, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.821805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.842751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1097/2189] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:03 2022] PUT /identity/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757/users/bc6a4e199fa640f08a32be232914748b/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:03.844912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.859235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22fd79-4d81-42df-97d4-d1de9024a35c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.945774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:03.947277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:03.947570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:03.947839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:03.948568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:03.951710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:03.970094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1093/2190] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:03.972446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:03.988712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06662bbd-6a45-4c78-945f-149f9dabda14 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:03.998656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:04.000311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.001032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.001313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] PATH_INFO: `/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757/users/bc6a4e199fa640f08a32be232914748b/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.004599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28b36dbcbc44bf2a63c483eab7f4757, user_id=bc6a4e199fa640f08a32be232914748b, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:04.007298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad895229-2f4c-4546-96d3-73bdf33c0f9c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:04.023346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1098/2191] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:03 2022] PUT /identity/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757/users/bc6a4e199fa640f08a32be232914748b/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:04.049310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:04.051092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:04.060108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:04.085100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed4d6-7cf2-4bb4-b12a-4f20721174be admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:04.186663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:04.187562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.187846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.188121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] PATH_INFO: `/v3/projects/e74e22745fef43c6aa94e5e06cd0b756` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.203073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74e22745fef43c6aa94e5e06cd0b756)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:04.207239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:04.296656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74e22745fef43c6aa94e5e06cd0b756', 'request_id': 'req-39f97f7f-fdf8-4a23-ad94-1c83b2699022'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:04.320395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74e22745fef43c6aa94e5e06cd0b756', 'request_id': 'req-39f97f7f-fdf8-4a23-ad94-1c83b2699022'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:04.346552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74e22745fef43c6aa94e5e06cd0b756', 'request_id': 'req-39f97f7f-fdf8-4a23-ad94-1c83b2699022'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:04.383602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] The token cache is being invalidate because project e74e22745fef43c6aa94e5e06cd0b756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:04.383906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:04.384768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-39f97f7f-fdf8-4a23-ad94-1c83b2699022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:04.390071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1094/2192] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:04 2022] DELETE /identity/v3/projects/e74e22745fef43c6aa94e5e06cd0b756 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:04.392420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.392905 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.393496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.438817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:04.440961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:04.538326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1099/2193] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:04.540414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.541055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.541433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.577544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:04.579339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:04.595109 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1095/2194] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:04.598129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:04.632425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd31ef-d239-4c63-a662-216ebe2559c7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:04.653448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:04.656161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.656728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.657389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.658438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:04.660028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:04.663522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:04.698723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1100/2195] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:28:04.700228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:04.715037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c0e99-b66c-4e3e-96b9-8ba49baf27b8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:04.727463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:04.727463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.727463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.727463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.727862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:04.727862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:04.775789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1096/2196] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:04 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:04.778799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:04.795691 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de77561-4599-4f31-9f95-c5b3d40b67f5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:04.890190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:04.973506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:04.974396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:04.975696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:04.976514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:04.977227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:04.979172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.016132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1101/2197] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:04 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:05.019684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.031154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceab8a-03cc-45c7-9196-0dc64f1f9e71 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.046612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.047219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.047503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.047777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.050295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.054869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.076814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1097/2198] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:05.078999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.094185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a292-ae3c-4a5b-ad82-8fc03d4bdfa3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.105549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.106226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.106548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.106774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.107660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.109150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.131334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1102/2199] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:05.135541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.149426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfa3c-1bc5-4f90-83d8-a0fd427943d5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.162978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.163891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.164180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.164459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] PATH_INFO: `/v3/projects/e6807a3d7d4145e6b722f9a3f771d4d6/users/0967ad4544a04beeb7ef523c68f166cd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.189884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6807a3d7d4145e6b722f9a3f771d4d6, user_id=0967ad4544a04beeb7ef523c68f166cd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.199493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274ad0-4f23-4a99-ab16-7cbf503e359b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.229847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1098/2200] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:05 2022] PUT /identity/v3/projects/e6807a3d7d4145e6b722f9a3f771d4d6/users/0967ad4544a04beeb7ef523c68f166cd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:05.263388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.266452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.293883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aee4-66b1-4964-be67-ae9e859f4f28 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.318004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.320047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.320987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.371825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] MFA Rules not processed for user `0967ad4544a04beeb7ef523c68f166cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:05.373678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.404072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:05.431719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.433483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.434079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.434362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] PATH_INFO: `/v3/users/c2e4bd933b924e9d8fcf2416c1f0679d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.435630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e4bd933b924e9d8fcf2416c1f0679d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.437592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.469035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1099/2201] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:05.483331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.485583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.524310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e4bd933b924e9d8fcf2416c1f0679d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:05.525571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e4bd933b924e9d8fcf2416c1f0679d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:05.526452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e4bd933b924e9d8fcf2416c1f0679d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:05.535545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e4bd933b924e9d8fcf2416c1f0679d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:05.546890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-59af9371-a99d-4e9a-801c-cfd8a73a96e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e4bd933b924e9d8fcf2416c1f0679d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:05.574527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1103/2202] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:05 2022] DELETE /identity/v3/users/c2e4bd933b924e9d8fcf2416c1f0679d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:05.579866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.580688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.581672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.583064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63e856-478e-462a-a15a-204ebee9e720 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.604173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:05.605747 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.643850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:05.657596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.658290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.659376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.659376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.661352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.693645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1104/2203] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:05.708016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.714831 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.783222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.785668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.829928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1100/2204] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:05.851866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebafaa-739c-4d50-acc4-23e2d5f444b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.863084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.863648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.863931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.864435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.885287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.889319 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc1a4c-0749-4961-8bb6-1c1bd720b54f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:05.896936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:05.898737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:05.930929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3559635-5803-4e5a-a0eb-e38734cfdfb8 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:05.934640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1105/2205] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:05.947551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:05.950429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:05.950711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:05.951004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] PATH_INFO: `/v3/users/0967ad4544a04beeb7ef523c68f166cd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:05.953105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0967ad4544a04beeb7ef523c68f166cd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:05.955079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:06.043356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:06.131024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0967ad4544a04beeb7ef523c68f166cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.133775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0967ad4544a04beeb7ef523c68f166cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.138832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0967ad4544a04beeb7ef523c68f166cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.183497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0967ad4544a04beeb7ef523c68f166cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.211755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0967ad4544a04beeb7ef523c68f166cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.259714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1101/2206] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:05 2022] DELETE /identity/v3/users/0967ad4544a04beeb7ef523c68f166cd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:06.264129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:06.264420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:06.264704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:06.309778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:06.311001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:06.415937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1106/2207] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:06.452156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:06.454038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:06.587064 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464e70-8e9c-4771-beac-97ccbae289ab admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:06.608287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:06.608977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:06.609262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:06.609538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:06.634962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:06.637055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:06.656568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1102/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:06.808999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:06.810689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:06.850799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b51fe-dd81-47c8-8f0d-0267a56ee103 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:06.863089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:06.864334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:06.865071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:06.865509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] PATH_INFO: `/v3/projects/2e5a85ecc25a466e9511767b4cd01c46` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:06.867140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5a85ecc25a466e9511767b4cd01c46)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:06.869684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:06.947891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5a85ecc25a466e9511767b4cd01c46', 'request_id': 'req-ae2a142b-e216-4eed-b922-ee7688e92d89'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.959218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5a85ecc25a466e9511767b4cd01c46', 'request_id': 'req-ae2a142b-e216-4eed-b922-ee7688e92d89'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:06.982595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5a85ecc25a466e9511767b4cd01c46', 'request_id': 'req-ae2a142b-e216-4eed-b922-ee7688e92d89'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.006695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:07.013561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] The token cache is being invalidate because project 2e5a85ecc25a466e9511767b4cd01c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:07.013755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.014710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.019722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1107/2209] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:06 2022] DELETE /identity/v3/projects/2e5a85ecc25a466e9511767b4cd01c46 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:07.024318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:07.037675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf2ec-103d-4b2b-80e0-4480bc1b4dad service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:07.164917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:07.165850 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:07.166245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:07.166405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] PATH_INFO: `/v3/users/f22591a7b75a44eca6b6d7ba41f4cfda` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:07.169618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22591a7b75a44eca6b6d7ba41f4cfda)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:07.171723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:07.173576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:07.177923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:07.207967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a142b-e216-4eed-b922-ee7688e92d89 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:07.231354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:07.232991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:07.233293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:07.233577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] PATH_INFO: `/v3/projects/e6807a3d7d4145e6b722f9a3f771d4d6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:07.235700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6807a3d7d4145e6b722f9a3f771d4d6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:07.238648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:07.290372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:07.294516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22591a7b75a44eca6b6d7ba41f4cfda'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.297047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22591a7b75a44eca6b6d7ba41f4cfda'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.297872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22591a7b75a44eca6b6d7ba41f4cfda'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.317265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22591a7b75a44eca6b6d7ba41f4cfda'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.328545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22591a7b75a44eca6b6d7ba41f4cfda'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.357743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1103/2210] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:07 2022] DELETE /identity/v3/users/f22591a7b75a44eca6b6d7ba41f4cfda => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:07.376366 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6807a3d7d4145e6b722f9a3f771d4d6', 'request_id': 'req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.384707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6807a3d7d4145e6b722f9a3f771d4d6', 'request_id': 'req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.392259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6807a3d7d4145e6b722f9a3f771d4d6', 'request_id': 'req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.412372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] The token cache is being invalidate because project e6807a3d7d4145e6b722f9a3f771d4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:07.412780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.414300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1a662dd7-b8f7-4cc3-a292-d97b877fa8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:07.416587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1108/2211] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:07 2022] DELETE /identity/v3/projects/e6807a3d7d4145e6b722f9a3f771d4d6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:08.481161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:08.482799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:08.640526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff2d2d-0e7b-4193-9fb0-457611926af3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:08.762653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:08.763550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:08.763829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:08.764284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] PATH_INFO: `/v3/projects/ea526d10b4004e5cbed2409b247a6eca` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:08.765746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea526d10b4004e5cbed2409b247a6eca)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:08.768078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:08.847964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea526d10b4004e5cbed2409b247a6eca', 'request_id': 'req-7133e1b0-92fb-44da-84e1-45f091ce092e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:08.862826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea526d10b4004e5cbed2409b247a6eca', 'request_id': 'req-7133e1b0-92fb-44da-84e1-45f091ce092e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:08.874260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea526d10b4004e5cbed2409b247a6eca', 'request_id': 'req-7133e1b0-92fb-44da-84e1-45f091ce092e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:08.886063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:08.896165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] The token cache is being invalidate because project ea526d10b4004e5cbed2409b247a6eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:08.896802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:08.898239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-7133e1b0-92fb-44da-84e1-45f091ce092e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:08.900348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1104/2212] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:08 2022] DELETE /identity/v3/projects/ea526d10b4004e5cbed2409b247a6eca => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:08.906526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:08.907007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:08.907007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:08.958663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:08.959921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:09.090363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1109/2213] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:09.104998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.106332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.106781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.140654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:09.142837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:09.156379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1105/2214] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:09.160735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.171292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce5fe-d11d-4d95-9579-dc7e6636fa7c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.178210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.179102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.179570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.180322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.181377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:09.181830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.184435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.200607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1110/2215] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:28:09.206132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.216052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dc1c4-0e45-40d1-a89b-bb2eaad0e9a0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.221514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.222386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.222776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.223225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.224010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.226229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.285223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1106/2216] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:09 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:09.288941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.302468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7e78a-7753-4248-bc06-b46e6acb6447 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.497021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.498135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.498861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.499297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.500237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.502529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.536346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:09.549097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.558043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1111/2217] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:09 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:09.563032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3eec2-1099-41ee-97cb-9729d3f7083d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.578610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.579547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.579976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.584661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.586837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.601873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.625487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1107/2218] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:09.626908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.641669 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50020cea-a165-4a6b-9fc1-839eb9849aea admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.654047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.654472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.654771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.655051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.655809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.657489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea10bad-cc9d-4335-b936-036b8ff9edfd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.706395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1112/2219] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:09.707363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:09.724822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce3d3-445f-448e-8c87-8fb3f908ee56 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:09.737460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:09.738600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.741313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.741758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] PATH_INFO: `/v3/projects/8aa6923b9ba9468ab69ead4f978e1bbc/users/dbc49d9ff0f74bac9f1e4889eb7d7335/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.817532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa6923b9ba9468ab69ead4f978e1bbc, user_id=dbc49d9ff0f74bac9f1e4889eb7d7335, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:09.832080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:09.866291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1108/2220] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:09 2022] PUT /identity/v3/projects/8aa6923b9ba9468ab69ead4f978e1bbc/users/dbc49d9ff0f74bac9f1e4889eb7d7335/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:09.876561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:09.876887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:09.877153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:09.913053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] MFA Rules not processed for user `dbc49d9ff0f74bac9f1e4889eb7d7335`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:09.915074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:10.016917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1113/2221] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:10.022245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.127631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ac596-8cdc-4ab0-939b-99f657b5a671 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.134892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.137174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.137598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.138007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.139036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.141235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.180335 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1109/2222] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:10 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:10.193280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.207485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86f2f-55fa-4923-bff0-3dc7f9ef73f3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.290312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.291652 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.291978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.292372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.293147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.295586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.352756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1114/2223] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:10 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:10.357594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.379148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4173b-07c0-4952-bea5-683036f9da0a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.402919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.403607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.403889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.404164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.404902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.406587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.436869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.446600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1110/2224] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:10.449612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195f8f0-a091-481b-899b-b5c8b309e85a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.454849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.455603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.456406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.456690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.457432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.459622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8adda-f732-4fcb-b91f-83bfd66b5e28 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.481672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.506203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1115/2225] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:10.506307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3a731-5d19-466e-abc3-25a9d28273e7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.521143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.524278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.524624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.525713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] PATH_INFO: `/v3/projects/7bea2794b0864c5aa3e58d5d778a8d90/users/9e0e497a60b04eb18e42ab12029c135d/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.553073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bea2794b0864c5aa3e58d5d778a8d90, user_id=9e0e497a60b04eb18e42ab12029c135d, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.555931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.586341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.586478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.586671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.590125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1111/2226] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:10 2022] PUT /identity/v3/projects/7bea2794b0864c5aa3e58d5d778a8d90/users/9e0e497a60b04eb18e42ab12029c135d/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:10.642717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] MFA Rules not processed for user `9e0e497a60b04eb18e42ab12029c135d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:10.645409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:10.715324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:10.759730 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.761869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1116/2227] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:10.853046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:10.878511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7028-87c2-4a7a-bc2d-38b631dc769c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:10.883513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:10.884196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:10.884485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:10.884764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:10.885468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:10.887428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:10.950258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1112/2228] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:10 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:10.952333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:10.981568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121bccf-5730-412a-bd93-09d7e0cd8ffd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.113949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.114657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.114980 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.115312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.115957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.118175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.146346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1117/2229] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:10 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:11.150095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.169918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f893efd-4c26-4469-86fa-891cf5cd381c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.180891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.182367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.182762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.183158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.184453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.187621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.210342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1113/2230] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:28:11.211770 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.227197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e08e6c-57c7-47c8-bcbc-118cdcf8e456 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.234331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.235775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.235775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.238391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] PATH_INFO: `/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0/users/b48494da2f2e4fc1a8e941db4ae26035/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.266228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422e3a1237544a27bf0b6f0fa4f4c2f0, user_id=b48494da2f2e4fc1a8e941db4ae26035, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.270276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.312955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1118/2231] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:11 2022] PUT /identity/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0/users/b48494da2f2e4fc1a8e941db4ae26035/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:11.317643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.336895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98db69-a2aa-4740-abfd-44033cac5048 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.412016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.412813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.413176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.413670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.415208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.417553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45634-85f8-4542-a09e-99830107413d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.436902 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1114/2232] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:11.440901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.453640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45094e-c465-4b93-ae53-8914e786afd3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.459697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.460640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.461055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.461346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] PATH_INFO: `/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0/users/b48494da2f2e4fc1a8e941db4ae26035/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.464007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422e3a1237544a27bf0b6f0fa4f4c2f0, user_id=b48494da2f2e4fc1a8e941db4ae26035, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.468529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.482760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1119/2233] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:11 2022] PUT /identity/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0/users/b48494da2f2e4fc1a8e941db4ae26035/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:11.499214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3051e-cd74-4d00-8951-04f9daa407a6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.502271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3051e-cd74-4d00-8951-04f9daa407a6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.502566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3051e-cd74-4d00-8951-04f9daa407a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.544741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-bfd3051e-cd74-4d00-8951-04f9daa407a6 None None] MFA Rules not processed for user `b48494da2f2e4fc1a8e941db4ae26035`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:11.546007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bfd3051e-cd74-4d00-8951-04f9daa407a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:11.642408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1115/2234] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:11.656080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.658378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:11.722519 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.722922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.723265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.781060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349c40-ae64-443a-b6ba-04238055dea5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.786322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.787221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.787706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.788206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:11.795172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] MFA Rules not processed for user `bc6a4e199fa640f08a32be232914748b`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:11.796388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:11.799586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:11.801256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:11.824421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1120/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:11.853031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:11.905113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.906750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:11.914442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1116/2236] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:11.925446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915bbb-10a6-4dff-8278-4a593cb9c8a5 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:11.939859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:11.941280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:11.944650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:11.946738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:11.946738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:11.946738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:12.029575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:12.053196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:12.054863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e7ac-5881-4a16-9655-a23fec3db913 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:12.060366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb757e-1d6a-41b8-9bb7-43e73c53b0f5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:12.067184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:12.068238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:12.068827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:12.069180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1121/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:12.069441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:12.071416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:12.159142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:12.161093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7cbcf-c844-4e33-ad60-c9618c107579 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:12.172333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1117/2238] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:13.606591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40676ba-e0be-4132-b8f1-f679adb2082e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:13.607107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40676ba-e0be-4132-b8f1-f679adb2082e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:13.607201 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40676ba-e0be-4132-b8f1-f679adb2082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:13.625581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f40676ba-e0be-4132-b8f1-f679adb2082e None None] MFA Rules not processed for user `c61d758271a44ee5acd682f175217506`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:13.626794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f40676ba-e0be-4132-b8f1-f679adb2082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:13.634510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1122/2239] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:14.591643 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:14.592516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:14.592991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:14.594848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1118/2240] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:28:14.614890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:14.615348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:14.615465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:14.646296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] MFA Rules not processed for user `e61587f7080b4cbcb3e906efaf4cb894`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:14.651106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:14.787577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1123/2241] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:14.800253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:14.802117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:14.844235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211affc-d4a0-4dbc-9ae4-474822f78b7e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:14.850745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:14.851504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:14.851982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:14.852330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:14.864195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:14.865803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee7923-1e3c-4966-867f-bfa752e3aca9 service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:14.876525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1119/2242] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:15.305248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:15.379850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685299f-a78a-4fb9-b434-54d9e795ab3c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:15.385422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:15.386491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:15.387011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:15.387526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] PATH_INFO: `/v3/users/dbc49d9ff0f74bac9f1e4889eb7d7335` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:15.388939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc49d9ff0f74bac9f1e4889eb7d7335)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:15.391141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:15.465051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc49d9ff0f74bac9f1e4889eb7d7335'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.465988 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc49d9ff0f74bac9f1e4889eb7d7335'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.466797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc49d9ff0f74bac9f1e4889eb7d7335'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.479816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc49d9ff0f74bac9f1e4889eb7d7335'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.495937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc49d9ff0f74bac9f1e4889eb7d7335'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.514425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:15.536643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1124/2243] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:15 2022] DELETE /identity/v3/users/dbc49d9ff0f74bac9f1e4889eb7d7335 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:15.542219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:15.543594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:15.543594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:15.566899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:15.569163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:15.581290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:15.584216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:15.664513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:15.677087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223ac94-5098-460a-af84-ae460adf6942 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:15.683215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:15.684345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:15.684805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:15.685229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] PATH_INFO: `/v3/users/12d9955dfd7d45948a4371c3218000eb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:15.685556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1120/2244] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:15.687316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d9955dfd7d45948a4371c3218000eb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:15.690454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:15.699869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:15.712060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:15.786358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce125fec-e615-425b-885b-eb406fb47250 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:15.790652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:15.791658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:15.792461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:15.792948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:15.804642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:15.806858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:15.816062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d9955dfd7d45948a4371c3218000eb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.818060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d9955dfd7d45948a4371c3218000eb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.818802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d9955dfd7d45948a4371c3218000eb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.824632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1121/2245] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:15.832384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d9955dfd7d45948a4371c3218000eb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.859048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d9955dfd7d45948a4371c3218000eb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:15.903362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1125/2246] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:15 2022] DELETE /identity/v3/users/12d9955dfd7d45948a4371c3218000eb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:16.193492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:16.207804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092b77-3cfe-4b62-9f37-87ea858ce908 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:16.386878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:16.389437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:16.389889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:16.390332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] PATH_INFO: `/v3/projects/4ccf875a03c54946924d3a0f07ae1a2c` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:16.395200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccf875a03c54946924d3a0f07ae1a2c)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:16.397290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:16.484171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccf875a03c54946924d3a0f07ae1a2c', 'request_id': 'req-54af27bd-d6f5-498f-bf39-796aa0783993'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.489274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:16.490772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:16.501934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccf875a03c54946924d3a0f07ae1a2c', 'request_id': 'req-54af27bd-d6f5-498f-bf39-796aa0783993'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.520070 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e13db-5b50-4578-a540-34434885de58 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:16.546744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccf875a03c54946924d3a0f07ae1a2c', 'request_id': 'req-54af27bd-d6f5-498f-bf39-796aa0783993'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.592981 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] The token cache is being invalidate because project 4ccf875a03c54946924d3a0f07ae1a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:16.593420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.594642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.600358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1122/2247] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:16 2022] DELETE /identity/v3/projects/4ccf875a03c54946924d3a0f07ae1a2c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:16.605318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:16.607754 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:16.660781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:16.661844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:16.662337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:16.662811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] PATH_INFO: `/v3/projects/8aa6923b9ba9468ab69ead4f978e1bbc` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:16.664355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa6923b9ba9468ab69ead4f978e1bbc)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:16.666881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:16.668257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:16.686954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:16.784826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af27bd-d6f5-498f-bf39-796aa0783993 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:16.786966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa6923b9ba9468ab69ead4f978e1bbc', 'request_id': 'req-fb454353-df63-4053-bba0-3fdc8e7567ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.796336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa6923b9ba9468ab69ead4f978e1bbc', 'request_id': 'req-fb454353-df63-4053-bba0-3fdc8e7567ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.803446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa6923b9ba9468ab69ead4f978e1bbc', 'request_id': 'req-fb454353-df63-4053-bba0-3fdc8e7567ec'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.829411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] The token cache is being invalidate because project 8aa6923b9ba9468ab69ead4f978e1bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:16.829708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.831489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:16.834779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1126/2248] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:16 2022] DELETE /identity/v3/projects/8aa6923b9ba9468ab69ead4f978e1bbc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:16.838783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:16.841092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:16.889236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:16.890593 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:16.891280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:16.891841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] PATH_INFO: `/v3/users/b91c264e531e4b1192c72a12300249ac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:16.893787 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91c264e531e4b1192c72a12300249ac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:16.895919 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:16.936030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb454353-df63-4053-bba0-3fdc8e7567ec admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:16.943249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:16.944202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:16.944591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:16.945218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] PATH_INFO: `/v3/users/9e0e497a60b04eb18e42ab12029c135d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:16.946589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0e497a60b04eb18e42ab12029c135d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:16.950313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:17.003818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91c264e531e4b1192c72a12300249ac'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.005218 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91c264e531e4b1192c72a12300249ac'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.008852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91c264e531e4b1192c72a12300249ac'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.034969 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91c264e531e4b1192c72a12300249ac'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.036892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0e497a60b04eb18e42ab12029c135d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.037688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0e497a60b04eb18e42ab12029c135d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.038593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0e497a60b04eb18e42ab12029c135d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.043638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a755d81c-e2aa-406d-8eae-b035e7a4c1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91c264e531e4b1192c72a12300249ac'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.047393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0e497a60b04eb18e42ab12029c135d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.062467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1123/2249] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:16 2022] DELETE /identity/v3/users/b91c264e531e4b1192c72a12300249ac => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:17.071476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0e497a60b04eb18e42ab12029c135d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.099546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1127/2250] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:16 2022] DELETE /identity/v3/users/9e0e497a60b04eb18e42ab12029c135d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:17.257746 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.258077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.258358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.280943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] MFA Rules not processed for user `e18c00c7d6234928b870ecc419259666`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:17.286479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.359619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:17.381238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1124/2251] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:17.441625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:17.443509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.469548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:17.541996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b51f-31e1-4e08-a08e-1586a3188fe4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:17.554702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:17.555913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.556380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.556812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] PATH_INFO: `/v3/projects/0d0e7cea340f4683b556ce7cea4b8585` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.558455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0e7cea340f4683b556ce7cea4b8585)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:17.560657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:17.646197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:17.648285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.655573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0e7cea340f4683b556ce7cea4b8585', 'request_id': 'req-8a3a08b4-5331-49c8-aa06-812b2f909f07'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.662269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0e7cea340f4683b556ce7cea4b8585', 'request_id': 'req-8a3a08b4-5331-49c8-aa06-812b2f909f07'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.669998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1812d-8ab3-4d16-ab75-18dae0957e4a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:17.681889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0e7cea340f4683b556ce7cea4b8585', 'request_id': 'req-8a3a08b4-5331-49c8-aa06-812b2f909f07'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.719020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] The token cache is being invalidate because project 0d0e7cea340f4683b556ce7cea4b8585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:17.720212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.723620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8a3a08b4-5331-49c8-aa06-812b2f909f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.733446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1128/2252] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:17 2022] DELETE /identity/v3/projects/0d0e7cea340f4683b556ce7cea4b8585 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:17.739170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bf16-ae59-4693-ac33-1b35892cd7b7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.740060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bf16-ae59-4693-ac33-1b35892cd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.740802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bf16-ae59-4693-ac33-1b35892cd7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.760126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:17.761029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.761314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.761627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] PATH_INFO: `/v3/projects/7bea2794b0864c5aa3e58d5d778a8d90` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.763165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bea2794b0864c5aa3e58d5d778a8d90)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:17.765124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:17.767835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3e81bf16-ae59-4693-ac33-1b35892cd7b7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:17.769107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3e81bf16-ae59-4693-ac33-1b35892cd7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.786260 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1129/2253] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:17.787924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.790434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.790960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.830946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:17.832560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.834137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bea2794b0864c5aa3e58d5d778a8d90', 'request_id': 'req-a8d7406d-0f0d-438e-980f-b8db70026ac8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.842717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bea2794b0864c5aa3e58d5d778a8d90', 'request_id': 'req-a8d7406d-0f0d-438e-980f-b8db70026ac8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.858555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bea2794b0864c5aa3e58d5d778a8d90', 'request_id': 'req-a8d7406d-0f0d-438e-980f-b8db70026ac8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.877914 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] The token cache is being invalidate because project 7bea2794b0864c5aa3e58d5d778a8d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:17.878221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.878932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:17.880743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1125/2254] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:17 2022] DELETE /identity/v3/projects/7bea2794b0864c5aa3e58d5d778a8d90 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:17.885079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:17.886824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:17.910912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1130/2255] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:17.916245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:17.941232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3edd8-a12a-4806-91c2-e9d85058ee2b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:17.947351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:17.948119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.948479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.948830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.949641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:17.950050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:17.951738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:17.964989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1131/2256] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:28:17.969301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:17.976587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7406d-0f0d-438e-980f-b8db70026ac8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:17.983399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:17.984585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.984899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.985192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] PATH_INFO: `/v3/users/b48494da2f2e4fc1a8e941db4ae26035` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.987281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48494da2f2e4fc1a8e941db4ae26035)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:17.988587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b9c4-394c-43e8-ae7c-20f31aae2415 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:17.989347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:17.994565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:17.995519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:17.995857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:17.996884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:17.997074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.000120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.026858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:18.048091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1132/2257] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:28:18.049994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48494da2f2e4fc1a8e941db4ae26035'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.050127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.051220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48494da2f2e4fc1a8e941db4ae26035'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.052143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48494da2f2e4fc1a8e941db4ae26035'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.056569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:18.069318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48494da2f2e4fc1a8e941db4ae26035'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.077010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48494da2f2e4fc1a8e941db4ae26035'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.090710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1126/2258] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:17 2022] DELETE /identity/v3/users/b48494da2f2e4fc1a8e941db4ae26035 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:18.167735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abe1c7-8f14-4d4c-8952-b7cca0599c63 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.266116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.267454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.268607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.269510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.270541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.273039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.314954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1133/2259] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:18 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:18.319752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.321369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.336410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589473f5-f6c1-4cb7-a972-b36da400c460 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.344234 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.344873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.345192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.345411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.346727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.348470 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.368123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1127/2260] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:18.371964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.384267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3e35-e4eb-4b0f-a48b-9885e98d4271 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.389868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.390938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.391058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.391367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.392112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.393754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c5f1-ce0c-40e1-b628-4b611cbf1235 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.407480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1134/2261] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:18.412843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.427890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ab4ec-8d1e-4cd4-a591-55445cd1e017 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.433587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.434669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.434995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.436500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] PATH_INFO: `/v3/projects/1a804a21f368424789205c83d59a13ef/users/03a608ecd7954df6b3d90f65a0a22ede/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.457972 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a804a21f368424789205c83d59a13ef, user_id=03a608ecd7954df6b3d90f65a0a22ede, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.462670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.486002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1128/2262] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:18 2022] PUT /identity/v3/projects/1a804a21f368424789205c83d59a13ef/users/03a608ecd7954df6b3d90f65a0a22ede/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:18.498345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.499627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.499918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.545008 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.555298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] MFA Rules not processed for user `03a608ecd7954df6b3d90f65a0a22ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:18.556235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.556663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.649825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1135/2263] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:18.652420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f106-ab56-4828-839b-ee4cc2e070ec admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.657598 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.659359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.659644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.659921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] PATH_INFO: `/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.661316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=422e3a1237544a27bf0b6f0fa4f4c2f0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.661520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.662998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.663259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.690920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:18.730667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422e3a1237544a27bf0b6f0fa4f4c2f0', 'request_id': 'req-f820f228-f74f-48d6-bdb9-c59597297bec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.738460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422e3a1237544a27bf0b6f0fa4f4c2f0', 'request_id': 'req-f820f228-f74f-48d6-bdb9-c59597297bec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.740163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4663753-ce4a-4177-a0eb-60aa7b7df38b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.750553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422e3a1237544a27bf0b6f0fa4f4c2f0', 'request_id': 'req-f820f228-f74f-48d6-bdb9-c59597297bec'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.768623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:18.775394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] The token cache is being invalidate because project 422e3a1237544a27bf0b6f0fa4f4c2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:18.776208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.777619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f820f228-f74f-48d6-bdb9-c59597297bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:18.786275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1129/2264] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:18 2022] DELETE /identity/v3/projects/422e3a1237544a27bf0b6f0fa4f4c2f0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:18.788061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ba97-c57b-446a-b404-bf9b70093855 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.788528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ba97-c57b-446a-b404-bf9b70093855 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.789038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ba97-c57b-446a-b404-bf9b70093855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.817500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3856ba97-c57b-446a-b404-bf9b70093855 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:18.819086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3856ba97-c57b-446a-b404-bf9b70093855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.824900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.825727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.826050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.826377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.828369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.908942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.909130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1130/2265] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:18.911461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:18.918202 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.918555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.919021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.940059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1136/2266] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:18.940561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:18.941706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:18.951376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1131/2267] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:18.956852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:18.976464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb67a-41c0-4848-a2b8-376c8c4a19f0 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:18.984305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:18.985064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:18.985466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:18.985822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:18.987261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:18.987639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:18.989432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.005735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1137/2268] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:28:19.010069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.020646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7b53-74c6-480a-b402-06e9a917a39a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.025940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.026484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.026770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.027042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.027731 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.029853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.059860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1132/2269] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:19 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:28:19.064157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.074191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd59bc-9f88-4824-a718-7f818fc2f97e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.135634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.136324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.136608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.136881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.137562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.139683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.172709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1138/2270] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:19 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:19.177782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.190378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826134-eed6-4cda-afde-41f060938c24 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.195108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.195772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.196041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.196316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.197041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.198682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.219680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1133/2271] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:28:19.220416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.232022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f291b-8fd8-4967-a652-67227d4dc659 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.236895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.237583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.237750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.238084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.238807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.240421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbebcf0-f00b-4db3-8650-c542c0ab26a9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.241783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:19.257073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1139/2272] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:19.261235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.275947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645df87-b357-452e-a93f-5b3d7715bf51 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.281321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.282406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.282697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.282975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] PATH_INFO: `/v3/projects/d4a5977ef41a40d79894a03465ebb42b/users/e88f473295b24c58a4fc5fceebd4b9bd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.302290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a5977ef41a40d79894a03465ebb42b, user_id=e88f473295b24c58a4fc5fceebd4b9bd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.305627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.321296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1134/2273] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:19 2022] PUT /identity/v3/projects/d4a5977ef41a40d79894a03465ebb42b/users/e88f473295b24c58a4fc5fceebd4b9bd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:19.333216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4311-d6f9-4752-bacd-c55748adda01 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.333592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4311-d6f9-4752-bacd-c55748adda01 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.334395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4311-d6f9-4752-bacd-c55748adda01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.369602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e67e4311-d6f9-4752-bacd-c55748adda01 None None] MFA Rules not processed for user `e88f473295b24c58a4fc5fceebd4b9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:19.370920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e67e4311-d6f9-4752-bacd-c55748adda01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:19.450901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1140/2274] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:19.463029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:19.464767 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:19.537020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279afe-bbff-410c-9891-6ef8be8e2cca admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:19.540717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:19.541448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:19.541801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:19.542219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:19.552131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:19.553740 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:19.565211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1135/2275] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:28.029685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a2a6-c301-4c01-b6c0-3e9e877d6c1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:28.030224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a2a6-c301-4c01-b6c0-3e9e877d6c1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:28.030318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a2a6-c301-4c01-b6c0-3e9e877d6c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:28.062614 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-eb62a2a6-c301-4c01-b6c0-3e9e877d6c1b None None] MFA Rules not processed for user `d79e251952bb4791a04ce88e90c11dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:28.063992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eb62a2a6-c301-4c01-b6c0-3e9e877d6c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:28.144249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1141/2276] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:29.559906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:31.906552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:31.908125 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.009033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08165541-774a-47fa-b304-98870f0c56ca service glance] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:32.020975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:32.022201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.022669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.026676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] PATH_INFO: `/v3/users/03a608ecd7954df6b3d90f65a0a22ede` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.029010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a608ecd7954df6b3d90f65a0a22ede)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:32.031563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:32.093176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a608ecd7954df6b3d90f65a0a22ede'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.093891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a608ecd7954df6b3d90f65a0a22ede'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.094578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a608ecd7954df6b3d90f65a0a22ede'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.117117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a608ecd7954df6b3d90f65a0a22ede'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.127394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a608ecd7954df6b3d90f65a0a22ede'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.151901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1136/2277] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:31 2022] DELETE /identity/v3/users/03a608ecd7954df6b3d90f65a0a22ede => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:32.153651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.154476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.154761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.180096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:32.181182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.245858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1142/2278] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:32.259873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:32.261781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.350369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388554aa-fd41-4eaf-b9ce-15adff803fe3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:32.354183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:32.354879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.355166 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.355563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.366679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:32.368121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e746c7-f90f-4706-9548-f76cf124683c service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:32.378260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1137/2279] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:32.721226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:32.722869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.735508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d242bdb-eed2-4e3c-b98f-ad512a5a1acf None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:32.740301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:32.741169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.741456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.741734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] PATH_INFO: `/v3/projects/1a804a21f368424789205c83d59a13ef` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.742976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a804a21f368424789205c83d59a13ef)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:32.745134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:32.786548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.806737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a804a21f368424789205c83d59a13ef', 'request_id': 'req-85fceba5-604a-401e-a04a-8ddb51d0b100'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.812743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a804a21f368424789205c83d59a13ef', 'request_id': 'req-85fceba5-604a-401e-a04a-8ddb51d0b100'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.819371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a804a21f368424789205c83d59a13ef', 'request_id': 'req-85fceba5-604a-401e-a04a-8ddb51d0b100'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.831431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] The token cache is being invalidate because project 1a804a21f368424789205c83d59a13ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:32.831718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.833140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85fceba5-604a-401e-a04a-8ddb51d0b100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:32.834798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1143/2280] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:32 2022] DELETE /identity/v3/projects/1a804a21f368424789205c83d59a13ef => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:32.839581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.839920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.840139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.859886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:32.861144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.879269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:32.924439 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1138/2281] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:32.932119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.932414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.932745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.951091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:32.952283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:32.961036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1144/2282] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:32.965076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:32.975718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b03e7-01c7-420c-b90c-a93feb4ebf11 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:32.980346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:32.980995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:32.981275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:32.981541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:32.982291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:32.982591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:32.984452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:32.995724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1139/2283] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:28:33.000031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.009856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad1063-166a-47ea-8e2d-5de5812a9942 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.014567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.015286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.015578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.015856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.016578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.018978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.048240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1145/2284] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:32 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:28:33.052318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.062538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a52d24-a265-4340-9202-be31634d9ee3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.119561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.120257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.120540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.120815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.121513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.123735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.143162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1140/2285] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:33.147823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.158238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013bf6c-8dca-46ff-9c1f-83a358eed93a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.162881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.163567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.163849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.164122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.164873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.166525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.177236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1146/2286] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:33.181088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.191141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c677f9-1f99-484d-81ea-ad04a33805d3 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.196319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.196968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.197252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.197528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.198281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.199865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715cbd5-0a7f-44e7-8114-1e5c5a9d1249 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.210361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1141/2287] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:33.216711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.228380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002f2a4-729a-4f88-aaa7-9fdccc6e1574 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.233302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.234402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.234686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.234963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] PATH_INFO: `/v3/projects/6f4b0133f69a4b6bbbb5204079ca1a55/users/437cffcd5c314b39ac502f5d2cf5af2f/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.251994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4b0133f69a4b6bbbb5204079ca1a55, user_id=437cffcd5c314b39ac502f5d2cf5af2f, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.255232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.267772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1147/2288] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:33 2022] PUT /identity/v3/projects/6f4b0133f69a4b6bbbb5204079ca1a55/users/437cffcd5c314b39ac502f5d2cf5af2f/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:33.279605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948007ad-40f2-4037-8400-038185a510fc None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.279896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948007ad-40f2-4037-8400-038185a510fc None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.280177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948007ad-40f2-4037-8400-038185a510fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.306559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-948007ad-40f2-4037-8400-038185a510fc None None] MFA Rules not processed for user `437cffcd5c314b39ac502f5d2cf5af2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:33.307764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-948007ad-40f2-4037-8400-038185a510fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:33.376224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1142/2289] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:33.381367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.464003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76f4f-855a-4b7a-96ec-e454a9bc19fc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.468718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.469317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.469600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.469873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.470672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.472577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.501945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1148/2290] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:28:33.503500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948007ad-40f2-4037-8400-038185a510fc None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.515394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948007ad-40f2-4037-8400-038185a510fc None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.528646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:33.577745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.578602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.579033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.579217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.580096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.584290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.607669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1143/2291] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:33.611678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.622515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0d557-6558-4116-bfaf-202cadcaa6e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.627372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.628022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.628300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.628568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.629959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.631552 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.642536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1149/2292] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:33.646474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.656315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd477fb7-507f-4151-acd3-e8a5da7bee07 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.660872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.661545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.661829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.662168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.662887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.664507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f40e7-897d-459f-8a08-55ba3ce201ad admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.674681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1144/2293] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:33.679078 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.689303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe73fa-b559-4c3d-9cb3-25f82381ec12 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.695082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.695936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.696554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.696736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] PATH_INFO: `/v3/projects/0318a24c13144b8ba4e594ee7b3e1f68/users/7558a40bdcf0467b99c964203d07f646/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.712176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0318a24c13144b8ba4e594ee7b3e1f68, user_id=7558a40bdcf0467b99c964203d07f646, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.714865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.723734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:33.728680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1150/2294] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:33 2022] PUT /identity/v3/projects/0318a24c13144b8ba4e594ee7b3e1f68/users/7558a40bdcf0467b99c964203d07f646/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:33.739618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.739993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.740391 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.775437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] MFA Rules not processed for user `7558a40bdcf0467b99c964203d07f646`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:33.776952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:33.847715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1145/2295] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:33.852700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.924157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb836-c780-4f98-8f13-56bc71b54b6f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:33.930059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:33.930726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:33.931009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:33.931289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:33.931991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:33.933919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:33.962500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1151/2296] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:33.966401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:33.977960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645624b0-7830-47d1-8fcf-c780413724ef None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.043143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.043823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.044106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.044379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.045085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.047025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.068783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1146/2297] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:33 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:34.072898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:34.083361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99c50-3793-4ea2-ba7f-67bb54a141ef admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.088139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.088799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.089083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.089359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.090119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.091752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.103014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1152/2298] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:34.107331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:34.118151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94f54d-9445-4355-a7fa-b5d2288aa772 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.122982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.123878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.124155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.124425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] PATH_INFO: `/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237/users/91066b32071b4b979c0eb8d735027008/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.136918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:34.140301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc8b9e714234e7fa0e5d0b89d4f4237, user_id=91066b32071b4b979c0eb8d735027008, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.143683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.156790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1147/2299] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:34 2022] PUT /identity/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237/users/91066b32071b4b979c0eb8d735027008/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:34.161278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:34.171936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e294-2956-4d81-9fd0-5b4b63df84ca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.238919 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.239500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.239784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.240058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.240780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.242408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187f5fe-9fd8-412d-acfc-54b87cdec034 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.252175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1153/2300] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:34.256298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:34.266714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bb35-cf37-4d86-9e21-02a17cbe0a94 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.272407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.273276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.273555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.273823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] PATH_INFO: `/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237/users/91066b32071b4b979c0eb8d735027008/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.275805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc8b9e714234e7fa0e5d0b89d4f4237, user_id=91066b32071b4b979c0eb8d735027008, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.278442 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.289946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1148/2301] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:34 2022] PUT /identity/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237/users/91066b32071b4b979c0eb8d735027008/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:34.300180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.300474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.300756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.326690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] MFA Rules not processed for user `91066b32071b4b979c0eb8d735027008`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:34.327997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:34.392012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:34.405830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1154/2302] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:34.414901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:34.416590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:34.482068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb008b-f598-4497-8384-c183bffc658e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:34.486706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:34.487365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:34.487721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:34.488000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:34.553872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:34.555361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:34.565327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1149/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:36.336265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:36.341683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:36.373812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a058cd-cb06-4d61-8932-514bdc647e48 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:36.392807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:36.393556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:36.395763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:36.396461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:36.503806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:36.509810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18b84-9d0f-4632-b67d-59a19b343f89 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:36.532792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1155/2304] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:37.520381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:37.532121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f42fd-5623-45d3-89b6-5c8449c8b12d service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:37.537230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:37.538188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:37.538780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:37.539424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:37.574789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:37.576346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:37.603672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1150/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:39.488812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:39.489312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:39.489547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:39.508439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:39.509718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:39.567871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1156/2306] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:39.626706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:39.628772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:39.729944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cdf3-5d6e-471b-8247-1f95948e3a69 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:39.736537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:39.737451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:39.737793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:39.738367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:39.749891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:39.751658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8518c70-509c-4765-ac4d-248cbde184da service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:39.764002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1151/2307] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:28:41.949020 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:42.160756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec08ff-28dc-48d1-af3b-ef434fbb8e4d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:42.167676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:42.169262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:42.169766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:42.170496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] PATH_INFO: `/v3/users/437cffcd5c314b39ac502f5d2cf5af2f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:42.172449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437cffcd5c314b39ac502f5d2cf5af2f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:42.176642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:42.276306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:42.299717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437cffcd5c314b39ac502f5d2cf5af2f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:42.300718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437cffcd5c314b39ac502f5d2cf5af2f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:42.309384 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437cffcd5c314b39ac502f5d2cf5af2f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:42.325472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437cffcd5c314b39ac502f5d2cf5af2f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:42.361122 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437cffcd5c314b39ac502f5d2cf5af2f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:42.402130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1157/2308] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:41 2022] DELETE /identity/v3/users/437cffcd5c314b39ac502f5d2cf5af2f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:42.403858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:42.404372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:42.404461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:42.450325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:42.451547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:42.466316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:42.660867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1152/2309] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:42.702598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:42.705009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:42.915097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82761c-f822-4dd5-b4dc-469dd15d83e1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:42.927670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:42.928600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:42.930567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:42.931162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:42.965826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:42.967958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:42.995002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1158/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:44.706900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:44.708443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:44.730978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f229be1-1893-4ba6-964b-62a94db8ec0f None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:44.760000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:44.761655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:44.762167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:44.763361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] PATH_INFO: `/v3/projects/6f4b0133f69a4b6bbbb5204079ca1a55` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:44.766786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4b0133f69a4b6bbbb5204079ca1a55)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:44.770173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:44.867048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4b0133f69a4b6bbbb5204079ca1a55', 'request_id': 'req-43a94280-68bc-4db5-be6b-34c945252846'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:44.883646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4b0133f69a4b6bbbb5204079ca1a55', 'request_id': 'req-43a94280-68bc-4db5-be6b-34c945252846'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:44.904513 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4b0133f69a4b6bbbb5204079ca1a55', 'request_id': 'req-43a94280-68bc-4db5-be6b-34c945252846'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:44.928051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] The token cache is being invalidate because project 6f4b0133f69a4b6bbbb5204079ca1a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:44.928260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:44.929022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:44.931217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1153/2311] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:44 2022] DELETE /identity/v3/projects/6f4b0133f69a4b6bbbb5204079ca1a55 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:44.934993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:44.947232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147c3ce-4adb-463f-9940-b4edb8ba5c9b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:45.026034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:45.027279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:45.027749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:45.028220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] PATH_INFO: `/v3/users/7558a40bdcf0467b99c964203d07f646` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:45.030045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7558a40bdcf0467b99c964203d07f646)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:45.032396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:45.107251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7558a40bdcf0467b99c964203d07f646'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:45.110150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7558a40bdcf0467b99c964203d07f646'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:45.112126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7558a40bdcf0467b99c964203d07f646'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:45.145722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7558a40bdcf0467b99c964203d07f646'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:45.162057 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7558a40bdcf0467b99c964203d07f646'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:45.163868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:45.209111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1159/2312] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:44 2022] DELETE /identity/v3/users/7558a40bdcf0467b99c964203d07f646 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:28:45.735709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:45.737823 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:45.761967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a94280-68bc-4db5-be6b-34c945252846 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:45.946763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:45.948274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:45.954637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:45.955903 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] PATH_INFO: `/v3/projects/0318a24c13144b8ba4e594ee7b3e1f68` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:45.959803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0318a24c13144b8ba4e594ee7b3e1f68)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:45.968469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:46.069325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:46.091577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0318a24c13144b8ba4e594ee7b3e1f68', 'request_id': 'req-b0e77053-c35f-4ff9-a455-a34b054c926c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.102324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0318a24c13144b8ba4e594ee7b3e1f68', 'request_id': 'req-b0e77053-c35f-4ff9-a455-a34b054c926c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.117219 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0318a24c13144b8ba4e594ee7b3e1f68', 'request_id': 'req-b0e77053-c35f-4ff9-a455-a34b054c926c'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.139232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] The token cache is being invalidate because project 0318a24c13144b8ba4e594ee7b3e1f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:46.139623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.140267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.142107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1154/2313] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:45 2022] DELETE /identity/v3/projects/0318a24c13144b8ba4e594ee7b3e1f68 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:46.146898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:46.149612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:46.182376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9cc0-d7f0-4b95-a789-ab13ab70988f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:46.256799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:46.258723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:46.259374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:46.260047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] PATH_INFO: `/v3/users/91066b32071b4b979c0eb8d735027008` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:46.262187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] RBAC: Authorizing `identity:delete_user(user_id=91066b32071b4b979c0eb8d735027008)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:46.265455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:46.345700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91066b32071b4b979c0eb8d735027008'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.346394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91066b32071b4b979c0eb8d735027008'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.348343 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91066b32071b4b979c0eb8d735027008'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.361736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91066b32071b4b979c0eb8d735027008'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.378904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6c9206f5-7503-462f-ab11-e3bde06067de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91066b32071b4b979c0eb8d735027008'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:46.406074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1160/2314] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:46 2022] DELETE /identity/v3/users/91066b32071b4b979c0eb8d735027008 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:47.291149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:47.293824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:47.317360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e77053-c35f-4ff9-a455-a34b054c926c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:47.408511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:47.413601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.414600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.415582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] PATH_INFO: `/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.419989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc8b9e714234e7fa0e5d0b89d4f4237)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:47.422658 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:47.500967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc8b9e714234e7fa0e5d0b89d4f4237', 'request_id': 'req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:47.504961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eefb-1a08-4024-9b27-ba8f0fc33100 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.506029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eefb-1a08-4024-9b27-ba8f0fc33100 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.506674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763eefb-1a08-4024-9b27-ba8f0fc33100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.508578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc8b9e714234e7fa0e5d0b89d4f4237', 'request_id': 'req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:47.525642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc8b9e714234e7fa0e5d0b89d4f4237', 'request_id': 'req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:47.529953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8763eefb-1a08-4024-9b27-ba8f0fc33100 None None] MFA Rules not processed for user `789516a0875a4925b6dcf62550aabad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:47.531402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8763eefb-1a08-4024-9b27-ba8f0fc33100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:47.557638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] The token cache is being invalidate because project abc8b9e714234e7fa0e5d0b89d4f4237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:47.558132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:47.558894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c2dbb3df-b8eb-47f3-8e58-4060fde945f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:47.561152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1155/2315] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:47 2022] DELETE /identity/v3/projects/abc8b9e714234e7fa0e5d0b89d4f4237 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:47.566612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.566955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.567518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.589290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:47.590689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:47.601317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1161/2316] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:47.670814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:47.692962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1156/2317] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:47.701565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.701938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.702446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.713186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:47.728422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:47.731461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:47.755875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1162/2318] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:47.756420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:47.767845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502d6f-ab3d-42fb-bf12-383a5cba7839 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:47.772845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:47.773528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.773813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.774136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.774988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:47.775306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:47.777043 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:47.794759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1157/2319] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:28:47.795888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:47.809923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd2214-cd76-489d-95ef-fc25dd806dba None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:47.817392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:47.818024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:47.818491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:47.818775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:47.819497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:47.821596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:47.857866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1163/2320] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:47 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:47.859525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:47.882682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a26ed-0b0a-4927-bce0-7fb66478e9c6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:48.005410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:48.011554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.011944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.012318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.013226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:48.019222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:48.066636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1158/2321] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:47 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:48.070467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:48.087438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff593f6-7093-4e3c-90a8-5d51439a2ab6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:48.102695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:48.103394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.104293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.104588 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.105562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:48.111394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:48.146753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1164/2322] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:48.149837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:48.166895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49d899-c44e-4476-8962-765b0318a08d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:48.179176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:48.181444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.183615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.184236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.185179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:48.188237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da49ee-aae9-4289-9285-49cdf8fb9922 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:48.213571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1159/2323] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:48.225163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:48.236228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f52d4-bd68-4c4c-8cf6-ac6b870f1037 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:48.253231 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:48.254353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.254634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.254958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] PATH_INFO: `/v3/projects/3047651594f0441aac8a7068139c17a0/users/066b59335ee74155a8bc4752540006a8/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.272416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3047651594f0441aac8a7068139c17a0, user_id=066b59335ee74155a8bc4752540006a8, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:48.275147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:48.307964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1165/2324] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:48 2022] PUT /identity/v3/projects/3047651594f0441aac8a7068139c17a0/users/066b59335ee74155a8bc4752540006a8/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:48.319832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.320321 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.324709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.387886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] MFA Rules not processed for user `066b59335ee74155a8bc4752540006a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:48.403820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:48.575266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1160/2325] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:48.588373 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:48.600252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:48.705603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fceab-51c3-4a9f-94df-92f43d70de06 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:48.710743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:48.714748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:48.715048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:48.715326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:48.725648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:48.727257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30da5b-b664-4df9-93dc-2b855f899d33 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:48.768419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1166/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:52.059861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:52.062524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:52.159409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:52.179651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b013e-8d84-48a8-afe0-d98c867e12d6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:52.186077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:52.187220 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:52.187885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:52.188411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] PATH_INFO: `/v3/users/e88f473295b24c58a4fc5fceebd4b9bd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:52.190073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88f473295b24c58a4fc5fceebd4b9bd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:52.192766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:52.360988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88f473295b24c58a4fc5fceebd4b9bd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:52.362443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88f473295b24c58a4fc5fceebd4b9bd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:52.363860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88f473295b24c58a4fc5fceebd4b9bd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:52.385618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88f473295b24c58a4fc5fceebd4b9bd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:52.400130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88f473295b24c58a4fc5fceebd4b9bd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:52.430406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1161/2327] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:28:52 2022] DELETE /identity/v3/users/e88f473295b24c58a4fc5fceebd4b9bd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:52.435689 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:52.436221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:52.436581 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:52.476234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:52.481134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:52.637783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1167/2328] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:52.671766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:52.673315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:52.813460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8016b4-4e86-4a15-8142-abab7a9d6c1a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:52.830334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:52.830922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:52.831201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:52.832182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:52.860232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:52.861699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f391f1c-5d1c-4051-bbec-105ff021b736 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:52.887382 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1162/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:28:53.425807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:53.427474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:53.446096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377d7c6-58e0-479f-b633-64022d206845 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:53.460657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:53.462437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:53.462977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:53.463685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] PATH_INFO: `/v3/projects/d4a5977ef41a40d79894a03465ebb42b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:53.465601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a5977ef41a40d79894a03465ebb42b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:53.468139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:53.537984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:53.556955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a5977ef41a40d79894a03465ebb42b', 'request_id': 'req-83c34646-4347-4c40-aeea-8b7c0eed2b7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:53.565449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a5977ef41a40d79894a03465ebb42b', 'request_id': 'req-83c34646-4347-4c40-aeea-8b7c0eed2b7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:53.574948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a5977ef41a40d79894a03465ebb42b', 'request_id': 'req-83c34646-4347-4c40-aeea-8b7c0eed2b7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:53.594963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] The token cache is being invalidate because project d4a5977ef41a40d79894a03465ebb42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:28:53.595303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:53.595964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-83c34646-4347-4c40-aeea-8b7c0eed2b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:28:53.598249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1168/2330] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:28:53 2022] DELETE /identity/v3/projects/d4a5977ef41a40d79894a03465ebb42b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:53.603973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:53.605204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:53.605655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:53.638518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:53.639653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:53.764653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1163/2331] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:53.777409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:53.802203 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:53.802797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:53.841692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:53.846545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:53.857949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1169/2332] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:53.863214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:53.876984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017fac-11ad-45a7-a38b-22c64254f8af None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:53.883446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:53.884517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:53.884970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:53.885395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:53.886332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:28:53.886815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:53.888594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:53.902330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:53.920982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1164/2333] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:28:53.925883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:53.940230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2abf-61f7-49d7-b191-d599d907ad66 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:53.959964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:53.960872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:53.961207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:53.961586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:53.962823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:53.964522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:54.056802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1170/2334] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:28:53 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:28:54.058529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:54.076177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52148-7843-46cc-a3eb-8e248503a542 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:54.408647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:54.410527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.411786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.412242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:54.413796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:54.416558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:54.495671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1165/2335] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:28:54 2022] POST /identity/v3/users => generated 292 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:28:54.496883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:54.509933 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775664-b361-482a-9d31-ba9a77bcf939 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:54.521683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:54.522912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.523200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.523476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:54.524222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:54.527247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:54.563697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:54.587659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1171/2336] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:54.616057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59cc8-f8f1-441d-8f07-7460e141203d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:54.621431 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:54.622552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.622908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.623256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:54.624093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:54.625786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44897f-cb99-4064-b6ab-dab50dff9724 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:54.645344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1166/2337] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:28:54.646985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:54.662246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd139674-490d-48b7-85eb-82c93428594f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:54.669043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:54.671363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.671804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.672240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] PATH_INFO: `/v3/projects/dcc5f8c3d4e945e799313609c49bcd26/users/6bdab6e229f74b098c18e5d4c2e9b3e3/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:54.717761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc5f8c3d4e945e799313609c49bcd26, user_id=6bdab6e229f74b098c18e5d4c2e9b3e3, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:54.721481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:54.747868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1172/2338] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:28:54 2022] PUT /identity/v3/projects/dcc5f8c3d4e945e799313609c49bcd26/users/6bdab6e229f74b098c18e5d4c2e9b3e3/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:28:54.748775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d8e4d-6117-47d8-8af3-a5b00ca1c46e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.749168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d8e4d-6117-47d8-8af3-a5b00ca1c46e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.749550 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d8e4d-6117-47d8-8af3-a5b00ca1c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:54.783479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1d4d8e4d-6117-47d8-8af3-a5b00ca1c46e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:54.789892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1d4d8e4d-6117-47d8-8af3-a5b00ca1c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:54.895734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1167/2339] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:28:54.907178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:54.908918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:54.984685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2ba8-4cc7-42b0-9155-f9340b02c914 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:54.988704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:54.989467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:54.989940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:54.993563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:55.005137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:55.006304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:55.020486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1173/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:56.373198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:56.373788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:56.373788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:56.432948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] MFA Rules not processed for user `6bdab6e229f74b098c18e5d4c2e9b3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:56.434458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:56.526675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:56.537183 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdc650-d1e3-4118-9917-39b13749a2cc service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:56.544851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:56.545676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:56.546209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:56.546712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:56.549304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:56.555029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1168/2341] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:28:56.568560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:28:56.570230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:56.595699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:56.684622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc99f11-9d86-4879-88d9-dd419ae6bd02 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:28:56.688782 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:28:56.689532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:56.690030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:56.690388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:56.700840 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:56.702756 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4afbe4-bea5-4259-9ec7-5a35ab20f12f service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:56.708976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:28:56.711740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92903753-ee57-4bdd-9f44-ec2ba2fca53f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:28:56.719084 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1169/2342] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:56.732685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:28:56.746860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1174/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:28:58.224889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:28:58.225506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:28:58.225506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:28:58.252773 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] MFA Rules not processed for user `6bdab6e229f74b098c18e5d4c2e9b3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:28:58.255413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:28:58.265937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1170/2344] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:07.438515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3540-9787-4303-a04c-64dc1642e51c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:07.439033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3540-9787-4303-a04c-64dc1642e51c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:07.439259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3540-9787-4303-a04c-64dc1642e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:07.466754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5a2d3540-9787-4303-a04c-64dc1642e51c None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:07.467964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5a2d3540-9787-4303-a04c-64dc1642e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:07.526741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1175/2345] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:07.539522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:07.541415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:07.657067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeda11-49c0-401a-95eb-9d5976fc942a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:07.662743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:07.663394 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:07.663681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:07.663959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:07.672085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:07.673742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:07.682488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1171/2346] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:29:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:29:07.828340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:07.828713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:07.829257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:07.856538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:07.857970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:07.880992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1176/2347] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:29:07.896579 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:07.917910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccc6a-dc30-478e-942c-bd36a0c9d165 service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:07.923717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:07.924536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:07.924735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:07.924980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:07.939216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:07.941010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:07.951964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1172/2348] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:29:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:29:10.693815 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:10.696065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:10.810594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb660b-1f17-4cae-ac05-62b5093f3f87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:10.819611 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:10.820511 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:10.820793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:10.821067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] PATH_INFO: `/v3/users/e18c00c7d6234928b870ecc419259666` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:10.825493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18c00c7d6234928b870ecc419259666)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:10.828377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:10.908864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18c00c7d6234928b870ecc419259666'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:10.912610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18c00c7d6234928b870ecc419259666'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:10.914272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18c00c7d6234928b870ecc419259666'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:10.934097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18c00c7d6234928b870ecc419259666'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:10.954040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-85e20fa7-6f6c-4958-9e1c-12c72169cc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18c00c7d6234928b870ecc419259666'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:10.984465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1177/2349] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:29:10 2022] DELETE /identity/v3/users/e18c00c7d6234928b870ecc419259666 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:11.206312 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:11.220311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48530b-3aed-4a3d-bb0e-f6bdd5d513ce service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:11.272612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:11.295005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:11.296024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.296374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.296718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] PATH_INFO: `/v3/projects/8fb58ed8e6534e3d917244da26236a1f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.298011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb58ed8e6534e3d917244da26236a1f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:11.300066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:11.358512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb58ed8e6534e3d917244da26236a1f', 'request_id': 'req-b2df7d89-5899-46ad-8e50-f3843c7803cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:11.365115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb58ed8e6534e3d917244da26236a1f', 'request_id': 'req-b2df7d89-5899-46ad-8e50-f3843c7803cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:11.374339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb58ed8e6534e3d917244da26236a1f', 'request_id': 'req-b2df7d89-5899-46ad-8e50-f3843c7803cd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:11.386835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] The token cache is being invalidate because project 8fb58ed8e6534e3d917244da26236a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:29:11.387259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:11.388009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-b2df7d89-5899-46ad-8e50-f3843c7803cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:11.389851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1173/2350] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:29:11 2022] DELETE /identity/v3/projects/8fb58ed8e6534e3d917244da26236a1f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:11.394958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.395248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.395528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.428123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:11.453640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:11.454937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:11.550418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1178/2351] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:11.558361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.558649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.558934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.579082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:11.580315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:11.591617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1174/2352] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:11.596844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:11.609134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a736-0fc6-4237-aab6-ce07930b005f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:11.615068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:11.615734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.616023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.616305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.617052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:29:11.617360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:11.619028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:11.639504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1179/2353] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:29:11.644238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:11.656258 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd489d-9266-4665-8394-d6b2df24c31a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:11.678599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:11.679427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.679786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.680307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.680896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:11.683078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:11.718616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1175/2354] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:29:11 2022] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:29:11.722755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:11.758637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b370-bbbc-4a5d-8c04-5e58333284f1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:11.907741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:11.910620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:11.910620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:11.910620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:11.910620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:11.912748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:11.961305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1180/2355] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:29:11 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:29:11.965448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:12.014142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41a82-8627-4804-84f1-6d9ecb30cb1b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:12.014142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:12.014142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:12.014142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:12.015694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:12.015694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:12.015694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:12.030282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1176/2356] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:12.034093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:12.045424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148971f-ac03-4c31-b589-894ea559e78b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:12.050658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:12.051392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:12.051680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:12.051958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:12.052962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:12.054743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fccfbd-836a-406e-990c-a732b90d40b7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:12.068169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1181/2357] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:12.072222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:12.083145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ba3fb-08c9-4186-8de0-2b9b8bd1c893 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:12.092921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:12.093835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:12.094693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:12.094956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] PATH_INFO: `/v3/projects/7a9e972df40b4a55b9e08fa50a3340bf/users/c07ed67d46e74574b9b7887530669e96/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:12.114086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9e972df40b4a55b9e08fa50a3340bf, user_id=c07ed67d46e74574b9b7887530669e96, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:12.118040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:12.148223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1177/2358] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:29:12 2022] PUT /identity/v3/projects/7a9e972df40b4a55b9e08fa50a3340bf/users/c07ed67d46e74574b9b7887530669e96/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:12.158173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:12.158460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:12.159055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:12.244975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] MFA Rules not processed for user `c07ed67d46e74574b9b7887530669e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:12.246274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:12.365716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:12.382402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1182/2359] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:12.396897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:12.398926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:12.490366 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9dc31-6bad-446c-a1bc-5a4c2c636c17 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:12.497615 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:12.499896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:12.500728 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:12.501464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:12.517466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:12.518978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ede3c3-945a-46c0-aebf-4d49cbe9e64e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:12.541386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1178/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:17.991065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:18.136492 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c0039-4fe0-4407-81ed-193c418d3fed None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:18.155362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:18.156302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:18.156582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:18.156854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] PATH_INFO: `/v3/users/c07ed67d46e74574b9b7887530669e96` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:18.161391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07ed67d46e74574b9b7887530669e96)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:18.163856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:18.261887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07ed67d46e74574b9b7887530669e96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:18.262606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07ed67d46e74574b9b7887530669e96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:18.263228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07ed67d46e74574b9b7887530669e96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:18.272058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07ed67d46e74574b9b7887530669e96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:18.279981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07ed67d46e74574b9b7887530669e96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:18.312224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1183/2361] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:29:17 2022] DELETE /identity/v3/users/c07ed67d46e74574b9b7887530669e96 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:18.316516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:18.316894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:18.320836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:18.339674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:18.340910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:18.346558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:18.469952 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1179/2362] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:29:18.478326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:18.480947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:18.668501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d32df-5b0b-4dab-849d-e06593493710 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:18.678634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:18.680168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:18.680574 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:18.681074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:18.700394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:18.707664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:18.714126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:18.756782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1184/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:19.212077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:19.213711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:19.228506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6884a1-b7ea-4609-a0a9-437dbe92b87b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:19.240568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:19.244170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:19.244398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:19.244650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] PATH_INFO: `/v3/projects/7a9e972df40b4a55b9e08fa50a3340bf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:19.246173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9e972df40b4a55b9e08fa50a3340bf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:19.249669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:19.307585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9e972df40b4a55b9e08fa50a3340bf', 'request_id': 'req-a989bca9-9c16-4455-9454-90ff33d6e897'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:19.326563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9e972df40b4a55b9e08fa50a3340bf', 'request_id': 'req-a989bca9-9c16-4455-9454-90ff33d6e897'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:19.357018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9e972df40b4a55b9e08fa50a3340bf', 'request_id': 'req-a989bca9-9c16-4455-9454-90ff33d6e897'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:19.369053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] The token cache is being invalidate because project 7a9e972df40b4a55b9e08fa50a3340bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:29:19.369344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:19.370042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a989bca9-9c16-4455-9454-90ff33d6e897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:19.371617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1180/2364] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:29:19 2022] DELETE /identity/v3/projects/7a9e972df40b4a55b9e08fa50a3340bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:20.974205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:20.975637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:20.988117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba34e53-afea-48a8-b293-52784d5a647a service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:21.043301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:21.044163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:21.044450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:21.044718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] PATH_INFO: `/v3/users/066b59335ee74155a8bc4752540006a8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:21.045891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b59335ee74155a8bc4752540006a8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:21.047825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:21.092882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b59335ee74155a8bc4752540006a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.093450 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b59335ee74155a8bc4752540006a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.094086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b59335ee74155a8bc4752540006a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.100756 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b59335ee74155a8bc4752540006a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.107763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b59335ee74155a8bc4752540006a8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.126559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1185/2365] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:29:20 2022] DELETE /identity/v3/users/066b59335ee74155a8bc4752540006a8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:21.131464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:21.131884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:21.132022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:21.150052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:21.151259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:21.213721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1181/2366] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:21.223430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:21.224827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:21.295100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a2a-3d59-4be3-82f3-d6c3939f9675 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:21.298903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:21.299640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:21.299927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:21.300298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:21.310667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:21.312134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1b46-8cb0-458d-a0fe-efa9351027c1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:21.322939 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1186/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:21.726861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:21.728420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:21.745872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcef630-1d85-4fa6-b90f-d613249a4013 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:21.775119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:21.776246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:21.776634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:21.777040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] PATH_INFO: `/v3/projects/3047651594f0441aac8a7068139c17a0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:21.778583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3047651594f0441aac8a7068139c17a0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:21.781454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:21.817447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:21.839690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3047651594f0441aac8a7068139c17a0', 'request_id': 'req-9d566429-4b46-4108-a697-375fcf02165d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.846792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3047651594f0441aac8a7068139c17a0', 'request_id': 'req-9d566429-4b46-4108-a697-375fcf02165d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.854911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3047651594f0441aac8a7068139c17a0', 'request_id': 'req-9d566429-4b46-4108-a697-375fcf02165d'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.866772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] The token cache is being invalidate because project 3047651594f0441aac8a7068139c17a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:29:21.867055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.867679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9d566429-4b46-4108-a697-375fcf02165d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:21.869214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1182/2368] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:29:21 2022] DELETE /identity/v3/projects/3047651594f0441aac8a7068139c17a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:21.874383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:21.874671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:21.874951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:21.904234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:21.905238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:21.909503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:21.972525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1187/2369] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:22.042500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.042792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.043157 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.062875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:22.064116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:22.073320 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1183/2370] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:22.077481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.088196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc8ab4-94a2-46af-8374-ece7bbb3cb5f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.092884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.093536 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.093823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.094125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.094866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:29:22.095176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.096786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.109753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1188/2371] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:29:22.114791 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.125177 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3344e3-464d-4ffb-b20b-6ce0248d9ae4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.131195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.132066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.132637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.132721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.133404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.135577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.165437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1184/2372] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:29:22 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:29:22.171294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.184188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428d18f-e448-4ceb-af64-1bce107d9b5e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.242569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.243238 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.243520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.243793 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.244490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.246439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.269464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1189/2373] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:29:22 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:29:22.272751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.283306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d7b2-6ad9-44f0-84ee-e8b0356eceb7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.291942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.292626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.292911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.293188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.293950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.295552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.309032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1185/2374] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:22.311565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.321557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754f526-3efc-4964-ab6b-cee08df1db61 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.326560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.327249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.327579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.327876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.328690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.330410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c2ae-80cd-4589-9aae-208b90d8f13b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.341634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1190/2375] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:22.345768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.356546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143afa-f49a-49b1-b470-5b2ad26e55c7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.361300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.362246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.362543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.363511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] PATH_INFO: `/v3/projects/08b97639634747a795764d88863d2c91/users/c3b996bee8964c83ab564642bb9bccf3/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.380092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b97639634747a795764d88863d2c91, user_id=c3b996bee8964c83ab564642bb9bccf3, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.382785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.395586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1186/2376] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:29:22 2022] PUT /identity/v3/projects/08b97639634747a795764d88863d2c91/users/c3b996bee8964c83ab564642bb9bccf3/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:22.405845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de88e-5473-45e1-982f-7444b0c66397 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.406179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de88e-5473-45e1-982f-7444b0c66397 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.406455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de88e-5473-45e1-982f-7444b0c66397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.433061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-984de88e-5473-45e1-982f-7444b0c66397 None None] MFA Rules not processed for user `c3b996bee8964c83ab564642bb9bccf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:22.434352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-984de88e-5473-45e1-982f-7444b0c66397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:22.499798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1191/2377] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:22.512153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:22.513815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:22.571428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370c5d-3d04-4edd-916a-35d00c297a0b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:22.575067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:22.575733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:22.576000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:22.576274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:22.585156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:22.586621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419273-9247-4935-91ab-0c535efef0fe service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:22.596296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1187/2378] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:25.096733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.097287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.097287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.098673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1192/2379] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:29:25.104959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748822-a09f-457f-a88c-7e397457160a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.105381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748822-a09f-457f-a88c-7e397457160a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.105515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748822-a09f-457f-a88c-7e397457160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.136976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ff748822-a09f-457f-a88c-7e397457160a None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:25.138212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ff748822-a09f-457f-a88c-7e397457160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:25.181796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:25.209586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1188/2380] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:25.221013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:25.222792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:25.232565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:25.288250 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079507d7-6de4-461e-b87f-6086441b6f63 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:25.291843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:25.292494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.292780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.293056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.304500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:25.306065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2015e-a9eb-4ed1-b3b7-6cf1489177bc service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:25.318027 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1193/2381] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:25.384901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.385116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.385446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.386833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1189/2382] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:29:25.391554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e786d-1281-449f-8cc7-bc2398e813c5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.391841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e786d-1281-449f-8cc7-bc2398e813c5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.392116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e786d-1281-449f-8cc7-bc2398e813c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.412245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fa6e786d-1281-449f-8cc7-bc2398e813c5 None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:25.413442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa6e786d-1281-449f-8cc7-bc2398e813c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:25.465295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1194/2383] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:25.477986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:25.479706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:25.493083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8a521-5699-4b40-b3c4-ac018a983ea6 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:25.497430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:25.498110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.498397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.498674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.506917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:25.508426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5809ca-8c15-48ab-a604-499d3d422297 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:25.516772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1190/2384] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:29:25.608506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4bcfa-9e37-40e6-8676-73b3e5909c26 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.608881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4bcfa-9e37-40e6-8676-73b3e5909c26 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.609258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4bcfa-9e37-40e6-8676-73b3e5909c26 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.610901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1195/2385] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:29:25.620761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c4c6-4649-4da5-ab39-5757f6eccc40 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.621048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c4c6-4649-4da5-ab39-5757f6eccc40 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.621325 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c4c6-4649-4da5-ab39-5757f6eccc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.641253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2ac6c4c6-4649-4da5-ab39-5757f6eccc40 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:25.642407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2ac6c4c6-4649-4da5-ab39-5757f6eccc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:25.652408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1191/2386] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:25.664149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4bcfa-9e37-40e6-8676-73b3e5909c26 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:25.677227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4bcfa-9e37-40e6-8676-73b3e5909c26 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:25.681110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:25.682087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:25.682370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:25.682645 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:25.694568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:25.696270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:25.707157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1196/2387] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:29:28.016057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:28.016723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:28.016723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:28.035670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:28.036928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:28.136432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1192/2388] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:29:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:28.151285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:28.152866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:28.227785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7e0b-b3ec-4fc3-a896-2ad623b1cd47 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:28.232905 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:28.233557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:28.234008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:28.234290 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:28.242777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:28.244412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f22419-ca18-486c-a53e-b6468492d7cf service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:28.252780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1197/2389] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:29:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:29:38.124451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=47 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:38.249579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:44.260829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:44.262309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:44.409679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365b92-0d8f-4431-811d-4ce62d781b1c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:44.415940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:44.416606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:44.416891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:44.417163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:44.419198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:44.437775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:44.439454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:44.451298 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1193/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:45.759160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a0cf-8d64-4570-8d56-31e76b3531d8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:45.759634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a0cf-8d64-4570-8d56-31e76b3531d8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:45.759728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a0cf-8d64-4570-8d56-31e76b3531d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:45.785086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5381a0cf-8d64-4570-8d56-31e76b3531d8 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:45.786886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5381a0cf-8d64-4570-8d56-31e76b3531d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:45.856430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1198/2391] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:45.874163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:45.875653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:45.919654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c9e4-4b70-42f8-a5fe-93e193472522 service placement] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:45.926475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:45.927676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:45.927956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:45.928227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:45.937232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:45.938839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:45.948793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1194/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:47.948873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a691ed-8efa-4200-9d42-521bfe6232b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:47.949413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a691ed-8efa-4200-9d42-521bfe6232b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:47.949512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a691ed-8efa-4200-9d42-521bfe6232b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:47.971590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01a691ed-8efa-4200-9d42-521bfe6232b8 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:47.984484 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01a691ed-8efa-4200-9d42-521bfe6232b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:47.992780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1199/2393] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:48.016433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:48.029620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67dbc7-6e51-4035-8d52-de2e8c88c240 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:48.034833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:48.035503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:48.035789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:48.036067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:48.045956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:48.047577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:48.057557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1195/2394] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:29:50.832277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993376e-1499-4a8c-ab5d-6be1c8ef154e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:50.832868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993376e-1499-4a8c-ab5d-6be1c8ef154e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:50.832868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993376e-1499-4a8c-ab5d-6be1c8ef154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:50.857502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a993376e-1499-4a8c-ab5d-6be1c8ef154e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:50.858775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a993376e-1499-4a8c-ab5d-6be1c8ef154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:50.867414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1200/2395] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:50.882968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:50.884514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:50.899762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca382cb-9327-41c6-bcce-2d889fef86db service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:50.905205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:50.905874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:50.906183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:50.906463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:50.915970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:50.917544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:50.927846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1196/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:54.076379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3ae4-ef4c-4cc0-9920-368427bb97b1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:54.076907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3ae4-ef4c-4cc0-9920-368427bb97b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:54.076907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd3ae4-ef4c-4cc0-9920-368427bb97b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:54.098022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-88bd3ae4-ef4c-4cc0-9920-368427bb97b1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:54.099223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88bd3ae4-ef4c-4cc0-9920-368427bb97b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:54.107222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1201/2397] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:54.126108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:54.137845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abadf4-cbae-415b-ae28-89339648d817 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:54.143812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:54.144539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:54.144822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:54.145094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:54.154624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:54.156203 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:54.166733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1197/2398] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:57.126794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:57.127291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:57.127291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:57.144943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:57.146159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:57.154009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1202/2399] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:57.172448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:57.184225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69631-0a54-4977-9ab7-f8f30e7e3881 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:57.189785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:57.190445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:57.190729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:57.191007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:57.199689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:57.201246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13317-ac4b-4572-b832-6afc85593919 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:57.211289 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1198/2400] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:57.697197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:57.706753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568d27-8e97-4065-809e-c38a0ea2c851 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:57.711351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:57.712212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:57.712490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:57.712761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] PATH_INFO: `/v3/users/c3b996bee8964c83ab564642bb9bccf3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:57.713964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b996bee8964c83ab564642bb9bccf3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:57.715926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:57.765432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b996bee8964c83ab564642bb9bccf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:57.766131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b996bee8964c83ab564642bb9bccf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:57.766763 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b996bee8964c83ab564642bb9bccf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:57.774158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b996bee8964c83ab564642bb9bccf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:57.781421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b996bee8964c83ab564642bb9bccf3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:57.799452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1203/2401] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:29:57 2022] DELETE /identity/v3/users/c3b996bee8964c83ab564642bb9bccf3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:29:57.804416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:57.804734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:57.805015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:57.822363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:57.823638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:57.864929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:57.884281 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1199/2402] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:57.893955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:57.895334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:57.946915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:57.952983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d0e4-bdde-4843-bd5c-4793fa1f9f1d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:57.957546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:57.958219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:57.958498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:57.958795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:57.967688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:57.969111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25719-dd01-4567-abf0-49a7e561ab7d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:57.979154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1204/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:29:58.260585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.262081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:58.274343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a612-ce54-438c-b0c9-230b1330b2c3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.279053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.279920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.280204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.280481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] PATH_INFO: `/v3/projects/08b97639634747a795764d88863d2c91` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.287105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b97639634747a795764d88863d2c91)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.287105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.334417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b97639634747a795764d88863d2c91', 'request_id': 'req-fa700eec-d5a4-4252-a99d-5f9fe50a7303'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:58.339916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b97639634747a795764d88863d2c91', 'request_id': 'req-fa700eec-d5a4-4252-a99d-5f9fe50a7303'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:58.347121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b97639634747a795764d88863d2c91', 'request_id': 'req-fa700eec-d5a4-4252-a99d-5f9fe50a7303'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:58.358547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] The token cache is being invalidate because project 08b97639634747a795764d88863d2c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:29:58.358963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:58.359637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa700eec-d5a4-4252-a99d-5f9fe50a7303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:29:58.361416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1200/2404] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:29:58 2022] DELETE /identity/v3/projects/08b97639634747a795764d88863d2c91 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:29:58.366705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.367206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.367416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.385938 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:58.387135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:58.444966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1205/2405] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:58.453738 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.454004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.454591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.474309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:58.475492 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:58.483283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1201/2406] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:58.487337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.497706 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03fb82-52e1-4fc3-ab3c-172d452eefd7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.502198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.502838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.503118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.503388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.504105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:29:58.504405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.506048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.517145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1206/2407] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:29:58.521295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.530402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edcb89-5c21-4321-8965-5c5214d45d85 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.534967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.535609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.535890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.536675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.537420 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.539392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.564438 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1202/2408] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:29:58 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:29:58.568472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.578700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76736cf-546e-4ba6-8ea2-bb39eb53f446 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.633314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.633987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.634266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.634539 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.635210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.637114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.655444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1207/2409] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:29:58 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:29:58.659666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.670711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e1d6f-edc1-49a5-9ea1-ab5033a4a04d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.675315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.675991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.676271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.676541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.677865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.679482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.689688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1203/2410] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:58.693586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.703565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59751-1238-426e-99f3-a09b9c44e99a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.708344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.708926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.709207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.709482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.710229 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.711814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19f3c-da35-4e8e-9c78-f040e431d9f4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.721461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1208/2411] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:29:58.725950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.735627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b8322-5cec-4756-afb6-5a9c7286c669 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.740788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.741651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.741953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.742230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] PATH_INFO: `/v3/projects/f6f8f44ce1ba42f5adef93cc25539dab/users/6635d8c430104a13bc2f64b5ed718bd4/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.756843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f8f44ce1ba42f5adef93cc25539dab, user_id=6635d8c430104a13bc2f64b5ed718bd4, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.759484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:58.774623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1204/2412] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:29:58 2022] PUT /identity/v3/projects/f6f8f44ce1ba42f5adef93cc25539dab/users/6635d8c430104a13bc2f64b5ed718bd4/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:29:58.784237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a4c2-9bb4-4620-9c76-8d457e4d78e3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.784596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a4c2-9bb4-4620-9c76-8d457e4d78e3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.784972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49a4c2-9bb4-4620-9c76-8d457e4d78e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.812348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4c49a4c2-9bb4-4620-9c76-8d457e4d78e3 None None] MFA Rules not processed for user `6635d8c430104a13bc2f64b5ed718bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:29:58.813549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4c49a4c2-9bb4-4620-9c76-8d457e4d78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:58.861630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:58.884748 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1209/2413] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:29:58.895276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:29:58.897447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:29:58.968260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:29:58.977562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9589a-551f-421f-b48f-bfe91d710e50 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:29:58.981517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:29:58.982198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:29:58.982479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:29:58.982750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:29:58.991367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:29:58.992786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd247c08-aaae-4c47-8b90-118d8d5b2029 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:29:59.001879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1205/2414] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:00.337245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:00.337736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:00.337842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:00.355320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] MFA Rules not processed for user `6635d8c430104a13bc2f64b5ed718bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:00.356487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:00.363288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1210/2415] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:02.409753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e716f-347e-4575-8d87-329e09f8d040 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:02.410783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e716f-347e-4575-8d87-329e09f8d040 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:02.411245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e716f-347e-4575-8d87-329e09f8d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:02.437133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4a9e716f-347e-4575-8d87-329e09f8d040 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:02.439119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4a9e716f-347e-4575-8d87-329e09f8d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:02.539692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1206/2416] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:02.556986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:02.558469 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:02.636589 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fac0d-b537-4703-ad67-a0c6f166838d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:02.642208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:02.642957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:02.643309 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:02.643654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:02.652441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:02.654158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de89c7-95b2-43ee-8ae6-64dda49a1f70 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:02.665155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1211/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:04.769860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:04.770443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:04.770443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:04.788801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] MFA Rules not processed for user `d79e251952bb4791a04ce88e90c11dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:04.790050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:04.853508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1207/2418] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:05.611413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95599bc-3877-49a4-b266-910c10e80036 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:05.611987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95599bc-3877-49a4-b266-910c10e80036 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:05.611987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95599bc-3877-49a4-b266-910c10e80036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:05.632186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e95599bc-3877-49a4-b266-910c10e80036 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:05.633784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e95599bc-3877-49a4-b266-910c10e80036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:05.643221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1212/2419] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:05.667330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:05.680434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5143b-fa74-4d87-8cfa-153ce6e7f7c4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:05.687080 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:05.687858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:05.688345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:05.688655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:05.698075 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:05.699681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:05.711231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1208/2420] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:15.626031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=47 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:15.705096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=64 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:23.940385 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5def688-7b3c-4267-b67a-8799329241ba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:23.940910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5def688-7b3c-4267-b67a-8799329241ba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:23.940910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5def688-7b3c-4267-b67a-8799329241ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:24.013437 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c5def688-7b3c-4267-b67a-8799329241ba None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:24.015168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c5def688-7b3c-4267-b67a-8799329241ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:24.105106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1213/2421] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:24.123634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:24.126651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:24.253372 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e3d-404d-46a4-a65b-e03307b8969d service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:24.260462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:24.261063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:24.261352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:24.261669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:24.275248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:24.277806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:24.293374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1209/2422] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:24.841186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb260f-8c63-4212-bef9-cf0a49f02b59 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:24.842007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb260f-8c63-4212-bef9-cf0a49f02b59 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:24.842287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb260f-8c63-4212-bef9-cf0a49f02b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:24.860246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fbfb260f-8c63-4212-bef9-cf0a49f02b59 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:24.861422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fbfb260f-8c63-4212-bef9-cf0a49f02b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:24.869306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1214/2423] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:24.882763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:24.893301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0395c3-534e-4436-9985-02900dca9e21 service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:24.899120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:24.899761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:24.900094 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:24.900304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:24.910148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:24.911405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:24.919909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1210/2424] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:30:25.112903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c479-a533-42c8-99b8-b855407a1c81 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:25.113367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c479-a533-42c8-99b8-b855407a1c81 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:25.113460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704c479-a533-42c8-99b8-b855407a1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:25.131976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1704c479-a533-42c8-99b8-b855407a1c81 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:25.133163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1704c479-a533-42c8-99b8-b855407a1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:25.141075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1215/2425] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:25.156820 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:25.163730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:25.164023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:25.164328 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:25.168714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609646d-6929-4e4e-9344-473baaa6d078 service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:25.173963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:25.174612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:25.174898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:25.175296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:25.183843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:25.185484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c1822-3d45-4f42-9497-1a469512060c service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:25.185674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] MFA Rules not processed for user `6bdab6e229f74b098c18e5d4c2e9b3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:25.186917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:25.194118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1211/2426] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:30:25.249461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1216/2427] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:30:25.523039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:25.523330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:25.523606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:25.541790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:25.543031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:25.550742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1212/2428] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:25.563587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:25.575403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffea105-e164-429c-92d0-5c543591cdd6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:25.580347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:25.581074 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:25.581421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:25.581757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:25.590191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:25.591847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b10332-8cd7-4f98-a955-75f84d0fc9b2 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:25.600794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1217/2429] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:30:27.710656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:27.724225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a04547-c26f-43cf-ad27-8dbad8e5ad85 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:27.730994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:27.731874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:27.732147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:27.732421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] PATH_INFO: `/v3/users/6635d8c430104a13bc2f64b5ed718bd4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:27.733621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6635d8c430104a13bc2f64b5ed718bd4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:27.736853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:27.793706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6635d8c430104a13bc2f64b5ed718bd4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:27.794924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6635d8c430104a13bc2f64b5ed718bd4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:27.795694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6635d8c430104a13bc2f64b5ed718bd4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:27.812224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6635d8c430104a13bc2f64b5ed718bd4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:27.820969 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6635d8c430104a13bc2f64b5ed718bd4'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:27.838713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1213/2430] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:30:27 2022] DELETE /identity/v3/users/6635d8c430104a13bc2f64b5ed718bd4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:30:27.842942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:27.843411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:27.843725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:27.865325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:27.866788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:27.922277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:27.938345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1218/2431] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:27.948931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:27.950476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:27.963709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:28.024572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76ef05-c42a-49ab-a993-4a86daba7416 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:28.028676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:28.029575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:28.029950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:28.030240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:28.047809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:28.049474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593ed3-c36c-4468-8235-a890b861a241 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:28.079999 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1214/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:28.392996 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:28.395098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:28.409782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a3c34-eeec-4a09-8d0d-cd2bb6e8da73 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:28.432626 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:28.450389 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:28.451067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:28.454530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] PATH_INFO: `/v3/projects/f6f8f44ce1ba42f5adef93cc25539dab` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:28.458433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f8f44ce1ba42f5adef93cc25539dab)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:28.461429 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:28.535368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f8f44ce1ba42f5adef93cc25539dab', 'request_id': 'req-2d1f52db-5764-40c3-a18e-e20f3adb8934'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:28.550233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f8f44ce1ba42f5adef93cc25539dab', 'request_id': 'req-2d1f52db-5764-40c3-a18e-e20f3adb8934'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:28.559676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f8f44ce1ba42f5adef93cc25539dab', 'request_id': 'req-2d1f52db-5764-40c3-a18e-e20f3adb8934'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:28.578584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] The token cache is being invalidate because project f6f8f44ce1ba42f5adef93cc25539dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:30:28.579050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:28.580335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2d1f52db-5764-40c3-a18e-e20f3adb8934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:30:28.583034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1219/2433] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:30:28 2022] DELETE /identity/v3/projects/f6f8f44ce1ba42f5adef93cc25539dab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:30:38.058214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=22 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:38.344625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:38.345129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:38.345459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:38.363990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] MFA Rules not processed for user `855568cbf9da4d3680a1f212fa9e4222`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:38.365340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:38.425584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1215/2434] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:38.573577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:30:40.565965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236f70-e5ae-4331-9168-3c267631820c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:40.566560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236f70-e5ae-4331-9168-3c267631820c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:40.566700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236f70-e5ae-4331-9168-3c267631820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:40.585194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-43236f70-e5ae-4331-9168-3c267631820c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:40.586564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43236f70-e5ae-4331-9168-3c267631820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:40.647487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1220/2435] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:40.661521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:40.663608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:40.743650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a035ea3-3c1a-4394-b497-735d3ef16277 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:40.749386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:40.750065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:40.750351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:40.750627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:40.758955 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:40.760532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005e04-c645-4179-8a33-f4cf23777a71 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:40.770029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1216/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:43.039030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:43.039531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:43.039658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:43.059683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] MFA Rules not processed for user `789516a0875a4925b6dcf62550aabad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:43.060897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:43.113419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1221/2437] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:44.915876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a2b-e54e-413d-9164-a02bbc49e6c4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:44.916426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a2b-e54e-413d-9164-a02bbc49e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:44.916672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2a2b-e54e-413d-9164-a02bbc49e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:44.936583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f8fb2a2b-e54e-413d-9164-a02bbc49e6c4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:44.937805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f8fb2a2b-e54e-413d-9164-a02bbc49e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:44.946105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1217/2438] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:30:44.961287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:44.976862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bcf7-50bf-4451-9d77-f6464c2ba1f8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:44.982335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:44.982991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:44.983268 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:44.983540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:44.992791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:44.994678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:45.004557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1222/2439] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:49.016525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80594b7-a2c8-4634-8d4f-c85f6f613c28 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:49.017018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80594b7-a2c8-4634-8d4f-c85f6f613c28 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:49.017195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80594b7-a2c8-4634-8d4f-c85f6f613c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:49.035195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d80594b7-a2c8-4634-8d4f-c85f6f613c28 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:49.038142 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d80594b7-a2c8-4634-8d4f-c85f6f613c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:49.046390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1218/2440] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:49.061251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:49.073330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7f66-dc32-4c13-a621-533f8776bdd2 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:49.079382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:49.080036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:49.080312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:49.080587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:49.089142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:49.090829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:49.100659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1223/2441] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:30:52.175781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb684e-1dd1-4115-9b43-f3d4daf9533c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:52.176294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb684e-1dd1-4115-9b43-f3d4daf9533c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:52.176410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb684e-1dd1-4115-9b43-f3d4daf9533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:52.195269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aedb684e-1dd1-4115-9b43-f3d4daf9533c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:52.196478 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aedb684e-1dd1-4115-9b43-f3d4daf9533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:52.205097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1219/2442] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:52.218955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:52.220426 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:52.234926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6e5ef-345c-46b7-86ed-c7227f494529 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:52.241012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:52.241658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:52.241979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:52.242257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:52.251221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:52.252806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:52.262945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1224/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:30:55.371812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258610b-635d-41a2-b8cf-6d0e7df558b4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:55.372336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258610b-635d-41a2-b8cf-6d0e7df558b4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:55.372336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258610b-635d-41a2-b8cf-6d0e7df558b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:55.390966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a258610b-635d-41a2-b8cf-6d0e7df558b4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:30:55.391975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a258610b-635d-41a2-b8cf-6d0e7df558b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:30:55.400337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1220/2444] 10.222.0.36 () {58 vars in 1016 bytes} [Wed Jul 6 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:30:55.416041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:30:55.427230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1204e04-c395-46fe-ad2b-7296093f896c service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:30:55.432720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:30:55.433428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:30:55.433777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:30:55.434151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:30:55.444015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:30:55.445813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:30:55.455498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1225/2445] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:05.385625 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=71 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:05.451133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=76 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:15.108891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:15.109412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:15.109512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:15.128882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] MFA Rules not processed for user `d79e251952bb4791a04ce88e90c11dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:15.130129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:15.184664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1221/2446] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:25.178244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=25 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:25.582839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:25.584355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:25.597224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a387c6-4def-41f3-8189-b4574c68eedc service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:25.602565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:25.603440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:25.603724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:25.604003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] PATH_INFO: `/v3/users/6bdab6e229f74b098c18e5d4c2e9b3e3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:25.605188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdab6e229f74b098c18e5d4c2e9b3e3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:25.607154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:25.653105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdab6e229f74b098c18e5d4c2e9b3e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.653733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdab6e229f74b098c18e5d4c2e9b3e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.654355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdab6e229f74b098c18e5d4c2e9b3e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.661572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdab6e229f74b098c18e5d4c2e9b3e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.668662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdab6e229f74b098c18e5d4c2e9b3e3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.685918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1226/2447] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:31:25 2022] DELETE /identity/v3/users/6bdab6e229f74b098c18e5d4c2e9b3e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:31:25.862010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:25.873421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9985ec-7be9-4b25-835c-76e3e509a5f8 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:25.932038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:25.932891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:25.933172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:25.933444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] PATH_INFO: `/v3/projects/dcc5f8c3d4e945e799313609c49bcd26` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:25.934634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc5f8c3d4e945e799313609c49bcd26)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:25.936538 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:25.981839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc5f8c3d4e945e799313609c49bcd26', 'request_id': 'req-1ebd2a62-6689-490b-a3bd-2932ff897032'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.987243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc5f8c3d4e945e799313609c49bcd26', 'request_id': 'req-1ebd2a62-6689-490b-a3bd-2932ff897032'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:25.994556 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc5f8c3d4e945e799313609c49bcd26', 'request_id': 'req-1ebd2a62-6689-490b-a3bd-2932ff897032'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:26.005472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] The token cache is being invalidate because project dcc5f8c3d4e945e799313609c49bcd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:31:26.005757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:26.006406 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:26.007922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1222/2448] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:31:25 2022] DELETE /identity/v3/projects/dcc5f8c3d4e945e799313609c49bcd26 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:35.682655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:36.002546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:36.201113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:36.202550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:36.261081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64fe17-ba98-47cf-a9f7-1c1d62c1af4a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:36.324053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:36.326024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:36.326024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:36.326024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:36.327126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:36.402770 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:36.404232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:36.415877 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1227/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:37.888158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:37.889570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:37.902354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd2a62-6689-490b-a3bd-2932ff897032 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:37.906124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:37.906778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:37.907063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:37.907339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:37.909123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:37.923479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:37.924942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:37.937209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1223/2450] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:46.410354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=74 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:47.932053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:48.711990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:48.713401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:48.724554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68988c3-cab7-49ae-93e7-0784af72ad48 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:48.728161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:48.728791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:48.729067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:48.729337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:48.731038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:48.792784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:48.794242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:48.804369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1228/2451] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:51.966449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:51.968014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:51.988428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c47a9b-2de3-41d3-84c7-7e106e6932eb service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:51.993156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:51.994332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:51.994618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:51.994912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] PATH_INFO: `/v3/users/789516a0875a4925b6dcf62550aabad9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:51.996096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789516a0875a4925b6dcf62550aabad9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:51.998052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.047619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789516a0875a4925b6dcf62550aabad9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.048300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789516a0875a4925b6dcf62550aabad9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.048911 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789516a0875a4925b6dcf62550aabad9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.060747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789516a0875a4925b6dcf62550aabad9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.067582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c7209b0b-5b78-4ddb-a860-c0dffd1d0837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789516a0875a4925b6dcf62550aabad9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.079863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1224/2452] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:31:51 2022] DELETE /identity/v3/users/789516a0875a4925b6dcf62550aabad9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:52.254493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.268410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616075-fa9f-450e-bbee-3859a7a16436 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.334914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.335778 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.336054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.336323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] PATH_INFO: `/v3/projects/d1624b1186184b1bb8e927f44d33f08a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.337502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1624b1186184b1bb8e927f44d33f08a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.339474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.391296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1624b1186184b1bb8e927f44d33f08a', 'request_id': 'req-537a2596-4a53-4cb0-8b05-5795a3d5841f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.397537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1624b1186184b1bb8e927f44d33f08a', 'request_id': 'req-537a2596-4a53-4cb0-8b05-5795a3d5841f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.403801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1624b1186184b1bb8e927f44d33f08a', 'request_id': 'req-537a2596-4a53-4cb0-8b05-5795a3d5841f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.417399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] The token cache is being invalidate because project d1624b1186184b1bb8e927f44d33f08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:31:52.417685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.418347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-537a2596-4a53-4cb0-8b05-5795a3d5841f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:52.420363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1229/2453] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:31:52 2022] DELETE /identity/v3/projects/d1624b1186184b1bb8e927f44d33f08a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:52.425314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.425710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.426021 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.444533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:52.445737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:52.503857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1225/2454] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:52.511930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.512224 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.512503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.531062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:52.532281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:52.540516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1230/2455] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:52.544532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.554079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277b577-b520-4e45-be54-d7d2120911fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.558661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.559306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.559588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.559876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.560581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:31:52.560886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.562510 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.574548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1226/2456] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:31:52.578675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.588458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4fd46-b0f6-4689-9283-95904c492285 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.593159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.593806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.594131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.594407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.595089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.596997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.611338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:52.626095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1231/2457] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:31:52 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:52.630294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.640362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d5c1-a7a0-4978-9fef-71044cc34157 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.698357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.699026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.699310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.699588 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.700273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.702273 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.709275 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:52.725348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1227/2458] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:31:52 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:52.729577 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.739856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e65f0-9e18-4a17-a29b-5d6c9bfb03c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.744695 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.745372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.745650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.745953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.746700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.748282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.758351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1232/2459] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:52.762101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.772473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dccedb-c823-4f0a-9f99-237f83a85fe8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.777038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.777678 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.777996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.778271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.779012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.780572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c07d6-974a-4899-940d-e0016160c85a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.791602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1228/2460] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:52.795525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.805808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9273af3-cbe9-4bdf-800c-88d93d0134ed admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.810406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.811265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.811545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.811817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] PATH_INFO: `/v3/projects/40af9171d09b47d597d8de33c997e9bf/users/a62fb5038d684773a3b5225ef0f81b3e/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.826462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40af9171d09b47d597d8de33c997e9bf, user_id=a62fb5038d684773a3b5225ef0f81b3e, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:52.829087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:52.841361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1233/2461] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:52 2022] PUT /identity/v3/projects/40af9171d09b47d597d8de33c997e9bf/users/a62fb5038d684773a3b5225ef0f81b3e/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:52.846323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146714a-4873-4e24-877d-4b60fa23e423 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.846621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146714a-4873-4e24-877d-4b60fa23e423 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.846900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146714a-4873-4e24-877d-4b60fa23e423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:52.864035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c146714a-4873-4e24-877d-4b60fa23e423 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:52.865752 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c146714a-4873-4e24-877d-4b60fa23e423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:52.922784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1229/2462] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:31:52.933003 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:52.934728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:52.989076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182219e-c3c8-482a-9296-5b973f993283 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:52.993141 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:52.994056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:52.994337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:52.994609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.003868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:53.005995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:53.015533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1234/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:53.613256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:53.613724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:53.613832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.640436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] MFA Rules not processed for user `a62fb5038d684773a3b5225ef0f81b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:53.641646 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:53.710734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1230/2464] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:53.715181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:53.725864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ef31-1322-42dc-ba43-2317ab6aec00 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:53.730812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:53.731556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:53.731836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:53.732107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.732797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:53.734759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:53.763946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1235/2465] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:31:53 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:53.765232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:53.777101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd0108-e1be-4425-a521-bca32572a7a5 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:53.834744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:53.835410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:53.835688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:53.835957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.836632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:53.838587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:53.852687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:53.861447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1231/2466] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:31:53 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:53.865605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:53.876292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685eb4e-952a-4fb5-a491-dbbfaefd566e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:53.881308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:53.882107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:53.882393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:53.882667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.883417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:53.885005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:53.896172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1236/2467] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:31:53.900091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:53.909983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02a1c-39ea-487c-8a27-7f81626b7717 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:53.914602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:53.915499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:53.915771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:53.916040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] PATH_INFO: `/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7/users/06f5456ec64343f19fafb85ed7c47e6c/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:53.930418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a352085d68cd4b14b1d85bd7f1d457e7, user_id=06f5456ec64343f19fafb85ed7c47e6c, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:53.933069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:53.946179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1232/2468] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:53 2022] PUT /identity/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7/users/06f5456ec64343f19fafb85ed7c47e6c/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:31:53.950247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:53.960777 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede60e51-8957-425b-8317-8b92601c092f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:54.014241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:54.014890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:54.015169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:54.015438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:54.016145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:54.017725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:54.027741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1237/2469] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:54.031856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:54.043989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e121-53f3-461a-8e11-7900ff06173b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:54.048785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:54.049707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:54.050011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:54.050285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] PATH_INFO: `/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7/users/06f5456ec64343f19fafb85ed7c47e6c/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:54.052247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a352085d68cd4b14b1d85bd7f1d457e7, user_id=06f5456ec64343f19fafb85ed7c47e6c, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:54.054892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9957b-c382-406d-8cf0-574bc79ef188 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:54.064943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1233/2470] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:54 2022] PUT /identity/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7/users/06f5456ec64343f19fafb85ed7c47e6c/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:31:54.221408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:54.223897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:54.258838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:54.306457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a7926-6a67-4551-ae23-315feb7022ac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:54.375852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:54.376517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:54.376786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:54.377066 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:54.378926 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:54.442902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:54.444523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:54.454572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1238/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:54.687117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:54.687632 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:54.687833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:54.715603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] MFA Rules not processed for user `06f5456ec64343f19fafb85ed7c47e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:54.716941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:54.790462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1234/2472] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:55.796149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:55.862441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7734c4-5148-4a2a-9a9f-9d0c9864bbb9 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:55.866975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:55.867840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:55.868117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:55.868637 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] PATH_INFO: `/v3/users/a62fb5038d684773a3b5225ef0f81b3e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:55.869798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62fb5038d684773a3b5225ef0f81b3e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:55.871738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:55.873974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:55.918415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62fb5038d684773a3b5225ef0f81b3e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:55.919082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62fb5038d684773a3b5225ef0f81b3e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:55.919692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62fb5038d684773a3b5225ef0f81b3e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:55.926624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62fb5038d684773a3b5225ef0f81b3e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:55.934129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62fb5038d684773a3b5225ef0f81b3e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:55.951547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1239/2473] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:31:55 2022] DELETE /identity/v3/users/a62fb5038d684773a3b5225ef0f81b3e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:56.126099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.137501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd1b49-054f-4e3b-b58b-249738793e83 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:56.194553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:56.195341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.195620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.195892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] PATH_INFO: `/v3/projects/40af9171d09b47d597d8de33c997e9bf` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.197049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40af9171d09b47d597d8de33c997e9bf)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:56.198984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:56.243102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:56.245205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40af9171d09b47d597d8de33c997e9bf', 'request_id': 'req-d7b61551-63d6-4de8-a967-168031b3afc1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.253430 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40af9171d09b47d597d8de33c997e9bf', 'request_id': 'req-d7b61551-63d6-4de8-a967-168031b3afc1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.261261 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40af9171d09b47d597d8de33c997e9bf', 'request_id': 'req-d7b61551-63d6-4de8-a967-168031b3afc1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.272781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] The token cache is being invalidate because project 40af9171d09b47d597d8de33c997e9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:31:56.273062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.273682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.275279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1235/2474] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:31:56 2022] DELETE /identity/v3/projects/40af9171d09b47d597d8de33c997e9bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:56.279280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.280771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:56.293998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cf7c-be41-41e4-a2d0-8f4f393f042d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:56.355348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:56.356251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.356532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.356805 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] PATH_INFO: `/v3/users/06f5456ec64343f19fafb85ed7c47e6c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.358008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f5456ec64343f19fafb85ed7c47e6c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:56.359927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:56.405855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f5456ec64343f19fafb85ed7c47e6c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.406509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f5456ec64343f19fafb85ed7c47e6c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.407099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f5456ec64343f19fafb85ed7c47e6c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.413729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f5456ec64343f19fafb85ed7c47e6c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.420955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2432c054-ed8a-4677-b9c0-153f17fd6b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f5456ec64343f19fafb85ed7c47e6c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.434295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:56.439251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1240/2475] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:31:56 2022] DELETE /identity/v3/users/06f5456ec64343f19fafb85ed7c47e6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:56.607718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.609152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:56.622877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61551-63d6-4de8-a967-168031b3afc1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:56.680624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:56.681489 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.681769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.682072 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] PATH_INFO: `/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.683242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a352085d68cd4b14b1d85bd7f1d457e7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:56.685188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:56.729852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a352085d68cd4b14b1d85bd7f1d457e7', 'request_id': 'req-c63e71b4-6cda-423d-9471-856140246033'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.735322 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a352085d68cd4b14b1d85bd7f1d457e7', 'request_id': 'req-c63e71b4-6cda-423d-9471-856140246033'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.742781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a352085d68cd4b14b1d85bd7f1d457e7', 'request_id': 'req-c63e71b4-6cda-423d-9471-856140246033'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.754283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] The token cache is being invalidate because project a352085d68cd4b14b1d85bd7f1d457e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:31:56.754562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.755763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c63e71b4-6cda-423d-9471-856140246033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:31:56.757277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1236/2476] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:31:56 2022] DELETE /identity/v3/projects/a352085d68cd4b14b1d85bd7f1d457e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:56.762325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.762612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.762884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.780502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:56.781683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:56.841657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1241/2477] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:56.849977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.850345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.850719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.878274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:56.879490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:56.887875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1237/2478] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:56.892091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.901865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba4b63-c80d-4c84-8080-65299eeefad9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:56.906677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:56.907463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.907816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.908170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.908965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:31:56.909336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:56.911538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:56.923504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1242/2479] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:31:56.928649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.937995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfec63-db06-4c3e-aecd-c619c5706b17 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:56.942629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:56.943304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:56.943582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:56.943857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:56.944567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:56.946488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:56.972278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1238/2480] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:31:56 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:31:56.976966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:56.987082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fce21b-412b-4586-af5c-7e0c5ddd2db6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.041922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.042580 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.042864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.043137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.043810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.045720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.066047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1243/2481] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:31:56 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:31:57.070251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.080239 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f25243-9f14-4fbd-b253-d9009eb8f0a0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.084971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.085631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.085931 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.086213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.086937 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.088532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.099468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1239/2482] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:31:57.103454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.113329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030de3e2-e682-4462-8733-95dea3b06d53 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.118842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.119512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.119795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.120209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.120976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.122709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59d66-8f12-4f42-9785-effcdac09028 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.133759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1244/2483] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:57.137948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.147924 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a990b5-c656-4b64-b5d5-978fa5e4317f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.152690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.153594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.153876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.154182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] PATH_INFO: `/v3/projects/8e35037186b04f46b0b9b2cd511a22d7/users/cbfd55b6445e428082abda6cf9fe1782/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.169313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e35037186b04f46b0b9b2cd511a22d7, user_id=cbfd55b6445e428082abda6cf9fe1782, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.172017 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.185665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1240/2484] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:57 2022] PUT /identity/v3/projects/8e35037186b04f46b0b9b2cd511a22d7/users/cbfd55b6445e428082abda6cf9fe1782/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:57.197161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.197454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.197736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.224743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] MFA Rules not processed for user `cbfd55b6445e428082abda6cf9fe1782`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:57.225958 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:57.279791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:57.290092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1245/2485] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:57.294628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.299073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:57.357562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6ce87-8a3a-452c-b487-fb268f435d7b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.362346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.362994 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.363272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.363544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.364248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.366163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.390453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1241/2486] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:31:57 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:57.394671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.405631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924218e7-a750-47fb-8942-ae1b6032d599 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.460639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.461296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.461575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.461847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.462786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.464679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.483993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1246/2487] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:31:57 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:31:57.487890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.498278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69b9f-2690-42be-9612-163291c7eeda admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.502864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.503507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.503783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.504055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.504818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.507380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.522667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1242/2488] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:57.523800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.533740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01299452-0eb7-4bbc-9b8a-bf5157a5e3ae admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.539853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.540749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.541009 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.541321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] PATH_INFO: `/v3/projects/7e9f7bb9f6764e108be535db99124b7d/users/2936c993818b45fe801ef8051d5e8dae/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.557618 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9f7bb9f6764e108be535db99124b7d, user_id=2936c993818b45fe801ef8051d5e8dae, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.560387 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.573785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1247/2489] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:57 2022] PUT /identity/v3/projects/7e9f7bb9f6764e108be535db99124b7d/users/2936c993818b45fe801ef8051d5e8dae/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:57.577675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.588238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da809d-9edb-4152-bac9-b55b5affebaa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.643636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.644140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.644429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.644695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.646032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.647623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6f27-9584-4f54-befb-1d738a7e8607 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.657344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1243/2490] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:31:57.661590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.671868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217791-441a-4455-bf3a-b19f30b61394 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.676463 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.677342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.677623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.677914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] PATH_INFO: `/v3/projects/7e9f7bb9f6764e108be535db99124b7d/users/2936c993818b45fe801ef8051d5e8dae/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.679885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9f7bb9f6764e108be535db99124b7d, user_id=2936c993818b45fe801ef8051d5e8dae, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.682558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.693136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1248/2491] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:31:57 2022] PUT /identity/v3/projects/7e9f7bb9f6764e108be535db99124b7d/users/2936c993818b45fe801ef8051d5e8dae/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:31:57.703254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.703545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.703824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.730596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] MFA Rules not processed for user `2936c993818b45fe801ef8051d5e8dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:57.731900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:57.792980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:57.799299 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1244/2492] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:31:57.810304 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.812048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:57.869824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4cceb-3770-4d2e-9e93-29a019a1ffa8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.873507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.874178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.874462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.874734 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:57.883622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:57.885040 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7b2f7-12af-43c5-892b-ef21cf462eb3 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:57.894784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1249/2493] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:57.964189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:31:57.974447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c245d-15d3-4200-a32b-acca889643f4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:31:57.978267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:31:57.978916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:57.979444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:57.979563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:58.041552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:31:58.043105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:31:58.054058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1245/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:31:59.891485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:31:59.891967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:31:59.892082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:31:59.910527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:31:59.912028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:31:59.958048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:31:59.969012 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1250/2495] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:00.014934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:00.016368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:00.087290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e233bf-affe-4257-9ecc-86dc26f7160c service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:00.092188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:00.092856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:00.093121 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:00.093396 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:00.102041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:00.103612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:00.111582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1246/2496] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:32:04.901750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:04.903314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:04.994579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5050-9e61-41ee-a3ca-fd28300296e4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:05.000955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:05.001679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:05.002072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:05.002425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:05.004305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:05.076512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:05.078137 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:05.088529 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1251/2497] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:09.497277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:09.499567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:09.574866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffacb1-00ee-45c7-9f42-2270751832cb service swift] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:09.579183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:09.579854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:09.580475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:09.580797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:09.582629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:09.594988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:09.597520 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6ead5-3463-4544-9e58-1e1c3b3f9a4b service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:09.610271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1247/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:14.473293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:14.487245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942cd95-cc10-40f8-a21a-f9862681fe99 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:14.494733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:14.495599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:14.496039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:14.496468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:14.498506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:14.514111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:14.516454 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbaa876-3566-4ba8-ae06-5f67afbf5fda service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:14.539827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1252/2499] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:14.674857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:14.675401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:14.675535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:14.677127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1248/2500] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:32:14.688159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9030-7e76-437d-b580-aaab885f1ce6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:14.688537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9030-7e76-437d-b580-aaab885f1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:14.688814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9030-7e76-437d-b580-aaab885f1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:14.749525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-211a9030-7e76-437d-b580-aaab885f1ce6 None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:14.754773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-211a9030-7e76-437d-b580-aaab885f1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:14.766937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1253/2501] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:14.783276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:14.785359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:14.837890 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:14.885986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e8800-f284-428a-9b0b-bc1e999b3af3 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:14.890471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:14.891266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:14.891555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:14.891833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:14.903015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:14.904437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345820-ee57-4b22-bacc-1fcde6cd1269 service glance] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:14.920077 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1249/2502] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:14.993817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cffce-57e0-42e3-b380-0e03f3048351 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:14.994330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cffce-57e0-42e3-b380-0e03f3048351 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:14.994617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cffce-57e0-42e3-b380-0e03f3048351 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:14.997181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1254/2503] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:32:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:32:15.002189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d48b1-65f9-483a-9e75-dfac73b17644 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.002611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d48b1-65f9-483a-9e75-dfac73b17644 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.003097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d48b1-65f9-483a-9e75-dfac73b17644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.043279 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-f48d48b1-65f9-483a-9e75-dfac73b17644 None None] MFA Rules not processed for user `fa7ffb1028c44466a4192e0c17bb7df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:15.044950 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f48d48b1-65f9-483a-9e75-dfac73b17644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:15.052151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1250/2504] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:15.064410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cffce-57e0-42e3-b380-0e03f3048351 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:15.075749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cffce-57e0-42e3-b380-0e03f3048351 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:15.079499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:15.080159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.080438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.080709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.089015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:15.090531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507886d-ee92-44a9-92b0-36450b00cd8c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:15.099056 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1255/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:15.185786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9b02-c69c-4c6c-9918-a450a11fd6fb None None] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.186184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9b02-c69c-4c6c-9918-a450a11fd6fb None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.186532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9b02-c69c-4c6c-9918-a450a11fd6fb None None] PATH_INFO: `/` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.188027 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1251/2506] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 15:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 15:32:15.193143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.193472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.193752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.212824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] MFA Rules not processed for user `92191aff46eb4e98b5923c3ad95a8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:15.213987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:15.226091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1256/2507] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:15.236292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9b02-c69c-4c6c-9918-a450a11fd6fb None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:15.248120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9b02-c69c-4c6c-9918-a450a11fd6fb None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:15.252657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:15.253374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.253725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.254097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.265407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:15.266918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b8181-7c49-42a5-b1a3-6e19cbe4a6b3 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:15.278565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1252/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:15.342246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:15.343723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:15.388199 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:15.414355 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e918a-f5f1-4f5e-9d84-1b2c1847c43e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:15.419512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:15.420158 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:15.420444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:15.420716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:15.422528 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:15.435087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:15.436680 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:15.447882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1257/2509] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:17.267119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:17.267683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:17.267683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:17.289739 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:17.291354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:17.299635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1253/2510] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:17.314321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:17.327946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1bbfa-14b9-4a07-9c70-47f6f87ea708 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:17.334173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:17.335205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:17.335710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:17.336205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:17.346475 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:17.348462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:17.360034 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1258/2511] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:32:20.115336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:20.125496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7294f-fef9-43aa-8f78-7d6f42628ef4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:20.129768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:20.130461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:20.131293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:20.131650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:20.133566 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:20.242562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:20.249169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:20.266097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1254/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:24.272515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:24.274013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:24.294282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d700278-f111-4bff-8cbe-85653bf2a8f8 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:24.298901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:24.299994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:24.300533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:24.300972 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] PATH_INFO: `/v3/users/d79e251952bb4791a04ce88e90c11dbd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:24.302623 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79e251952bb4791a04ce88e90c11dbd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:24.304750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:24.395080 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79e251952bb4791a04ce88e90c11dbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.396521 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79e251952bb4791a04ce88e90c11dbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.397376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79e251952bb4791a04ce88e90c11dbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.407675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79e251952bb4791a04ce88e90c11dbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.421812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08494df9-dc50-443b-a6b7-4a1618042aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79e251952bb4791a04ce88e90c11dbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.453453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1259/2513] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:24 2022] DELETE /identity/v3/users/d79e251952bb4791a04ce88e90c11dbd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:24.778545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:24.792721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64bd2-d143-47c9-b09d-ef608b4a7fe6 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:24.910206 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:24.910790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:24.911085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:24.911359 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] PATH_INFO: `/v3/projects/fad462f254ef42e6a67dc4de21ed2a2d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:24.912637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad462f254ef42e6a67dc4de21ed2a2d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:24.914665 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:24.930051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:24.988733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad462f254ef42e6a67dc4de21ed2a2d', 'request_id': 'req-3925ce27-27be-47df-9993-ab0cc9aa41a1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:24.996451 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad462f254ef42e6a67dc4de21ed2a2d', 'request_id': 'req-3925ce27-27be-47df-9993-ab0cc9aa41a1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:25.010572 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad462f254ef42e6a67dc4de21ed2a2d', 'request_id': 'req-3925ce27-27be-47df-9993-ab0cc9aa41a1'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:25.028933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] The token cache is being invalidate because project fad462f254ef42e6a67dc4de21ed2a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:25.029679 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:25.031004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-3925ce27-27be-47df-9993-ab0cc9aa41a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:25.033872 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1255/2514] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:24 2022] DELETE /identity/v3/projects/fad462f254ef42e6a67dc4de21ed2a2d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:25.039086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.039375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.039925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.069498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:25.071083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:25.148398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1260/2515] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:25.156117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.156525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.156938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.199769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:25.201971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:25.212062 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1256/2516] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:25.216133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.227213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d1ea-3bf6-4fae-929d-903827317e6d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.231906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.232579 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.232863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.233139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.233872 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:25.234213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.235824 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.253658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1261/2517] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:25.256484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.266413 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c301379-8ad5-41bb-a250-8a53b571eaf0 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.271793 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.272512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.272817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.273107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.273812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.275783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.307417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1257/2518] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:25.311642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.323884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da3e6-55fc-4bed-b8c1-ffe4cc520144 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.337842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:25.402221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.402576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.402857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.403129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.403816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.405726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.425855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1262/2519] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:25.429963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.441706 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444239ea-c621-4fd4-ada8-ac906d63e8e1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.449809 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.450555 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.451093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.451377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.452117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.454215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.466181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1258/2520] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:25.470232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.480663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24f4-f3c1-4116-b600-35ad7e161812 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.485790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.486491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.486904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.487185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.488249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.492997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a716d4-131a-4dc6-b83b-b5e4431db1ae admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.509374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1263/2521] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:25.513616 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.524622 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ff6e-e031-42cd-b2d8-e8ef0a09e3da admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.529441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.530371 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.530657 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.530935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] PATH_INFO: `/v3/projects/661d21f7986945a6825edea0540c3871/users/33f46908f9e84d968a5866587e3808ae/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.546907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d21f7986945a6825edea0540c3871, user_id=33f46908f9e84d968a5866587e3808ae, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.550380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.566187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1259/2522] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:25 2022] PUT /identity/v3/projects/661d21f7986945a6825edea0540c3871/users/33f46908f9e84d968a5866587e3808ae/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:25.577441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.577726 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.578062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.604903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] MFA Rules not processed for user `33f46908f9e84d968a5866587e3808ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:25.606609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:25.675096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1264/2523] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:25.680108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.744709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426a19c-5ac9-4c48-bb75-c894b9188662 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.751617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.752576 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.752968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.753409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.754226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.758179 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.785447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1260/2524] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:25.786852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.797553 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40068-a6f0-41c2-877d-91af46ecdda5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.854294 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.854955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.855242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.855522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.856204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.858138 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.877737 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1265/2525] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:25 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:25.881711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.892459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774a6d-d68b-4ec0-8508-82c73148a1c1 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.897567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.898244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.898524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.898880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.899607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.901174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.911541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1261/2526] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:25.916261 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.926276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642c323-f94a-4e1f-a646-4ec5c1595f40 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.930945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:25.931813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:25.932095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:25.932368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] PATH_INFO: `/v3/projects/bc0c60875aaf4ebcae219a9740181dbf/users/f4f17190ac494eaa8682beebb18fc7df/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:25.944196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:25.951022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0c60875aaf4ebcae219a9740181dbf, user_id=f4f17190ac494eaa8682beebb18fc7df, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:25.954754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:25.970247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1266/2527] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:25 2022] PUT /identity/v3/projects/bc0c60875aaf4ebcae219a9740181dbf/users/f4f17190ac494eaa8682beebb18fc7df/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:25.981256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:25.992342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15993b-e2ff-4389-ad19-670628f4a5b4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:25.996638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:26.058922 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:26.059599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.059882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.060159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.060889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:26.062525 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493bdd9-0b1a-42d4-8cba-65c3cb53cccc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:26.075541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1262/2528] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:26.076599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:26.087200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526378-6f2e-4ff6-aad0-29f927de23af admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:26.091865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:26.092744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.093291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.093291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] PATH_INFO: `/v3/projects/bc0c60875aaf4ebcae219a9740181dbf/users/f4f17190ac494eaa8682beebb18fc7df/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.095433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0c60875aaf4ebcae219a9740181dbf, user_id=f4f17190ac494eaa8682beebb18fc7df, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:26.098082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:26.109361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1267/2529] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:26 2022] PUT /identity/v3/projects/bc0c60875aaf4ebcae219a9740181dbf/users/f4f17190ac494eaa8682beebb18fc7df/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:26.121081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.121364 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.121635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.160770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] MFA Rules not processed for user `f4f17190ac494eaa8682beebb18fc7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:26.162899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:26.263054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1263/2530] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:26.274952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:26.276765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:26.348922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59c254-630b-4b7d-b0f7-daa52bc7ee5d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:26.353321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:26.354062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.354349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.354624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.363806 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:26.365886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62395d-c429-4e08-93b0-39ae1974ea49 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:26.376011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1268/2531] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:26.504666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:26.565783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77576-5083-41c7-91fb-2291c176d309 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:26.570655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:26.571548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.571833 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.572107 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] PATH_INFO: `/v3/users/33f46908f9e84d968a5866587e3808ae` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.573405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f46908f9e84d968a5866587e3808ae)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:26.575368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:26.609560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:26.623826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f46908f9e84d968a5866587e3808ae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:26.624506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f46908f9e84d968a5866587e3808ae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:26.625115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f46908f9e84d968a5866587e3808ae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:26.636967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f46908f9e84d968a5866587e3808ae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:26.643846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f46908f9e84d968a5866587e3808ae'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:26.656845 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1264/2532] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:26 2022] DELETE /identity/v3/users/33f46908f9e84d968a5866587e3808ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:26.661274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.661647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.662538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.679323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:26.680436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:26.737572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1269/2533] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:26.747549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:26.748957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:26.805381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5028d36-bc9c-498b-a766-a3e52583d679 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:26.809022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:26.809669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:26.809984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:26.810265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:26.819711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:26.821131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:26.830485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1265/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:27.106431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:27.107886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:27.119780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb90a-452a-4bc4-9b45-af6e9ab5f9d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:27.124392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:27.125248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:27.125526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:27.125799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] PATH_INFO: `/v3/projects/661d21f7986945a6825edea0540c3871` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:27.127242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661d21f7986945a6825edea0540c3871)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:27.129267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:27.175220 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661d21f7986945a6825edea0540c3871', 'request_id': 'req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.181157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661d21f7986945a6825edea0540c3871', 'request_id': 'req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.187985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661d21f7986945a6825edea0540c3871', 'request_id': 'req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.201237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] The token cache is being invalidate because project 661d21f7986945a6825edea0540c3871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:27.201525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.202210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.203741 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1270/2535] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:27 2022] DELETE /identity/v3/projects/661d21f7986945a6825edea0540c3871 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:27.207717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:27.217221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35288bd-1fb2-47f5-bd74-feafa95b7bb8 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:27.272452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:27.273317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:27.273594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:27.273861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] PATH_INFO: `/v3/users/f4f17190ac494eaa8682beebb18fc7df` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:27.275052 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f17190ac494eaa8682beebb18fc7df)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:27.276960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:27.324656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f17190ac494eaa8682beebb18fc7df'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.325332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f17190ac494eaa8682beebb18fc7df'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.325959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f17190ac494eaa8682beebb18fc7df'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.330863 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:27.341004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f17190ac494eaa8682beebb18fc7df'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.348762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4298f0fc-6c14-4bc6-a4f7-d0801d56a1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f17190ac494eaa8682beebb18fc7df'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.363148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1266/2536] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:27 2022] DELETE /identity/v3/users/f4f17190ac494eaa8682beebb18fc7df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:27.723044 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:27.726207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:27.737033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:27.744247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4ae6e-92aa-48ac-87ca-098bf28d5132 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:27.804801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:27.805664 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:27.805969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:27.806244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] PATH_INFO: `/v3/projects/bc0c60875aaf4ebcae219a9740181dbf` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:27.807512 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0c60875aaf4ebcae219a9740181dbf)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:27.809573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:27.856895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0c60875aaf4ebcae219a9740181dbf', 'request_id': 'req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.862393 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0c60875aaf4ebcae219a9740181dbf', 'request_id': 'req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.869364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0c60875aaf4ebcae219a9740181dbf', 'request_id': 'req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.881000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] The token cache is being invalidate because project bc0c60875aaf4ebcae219a9740181dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:27.881288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.881918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea986185-e6bd-42ec-8b5d-4764a06b6e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:27.883459 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1271/2537] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:27 2022] DELETE /identity/v3/projects/bc0c60875aaf4ebcae219a9740181dbf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:27.888667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:27.889165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:27.889272 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:27.907898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:27.909087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:27.966748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1267/2538] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:27.975018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:27.975311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:27.975597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:27.994320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:27.995520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:28.003783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1272/2539] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:28.008401 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.017957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eaf67-185f-4efe-bc6a-befef26eed1c None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.023139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.023785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.024068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.024342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.025057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:28.025362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.026987 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.038878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1268/2540] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:28.042901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.052242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7db1-d67f-4f3d-b2d3-a3067c622053 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.056901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.057544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.057828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.058136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.058818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.060700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.086179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1273/2541] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:28.090600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.101050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd22bb-8373-44e8-af24-0e3ce0b81e30 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.157248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.157936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.158228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.158507 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.159212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.161128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.181471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1269/2542] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:28.185563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.196838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5893638-258a-4689-95c9-fbbc3073a3c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.201143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.201790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.202100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.202377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.203106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.204702 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.215866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1274/2543] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:28.219851 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.230443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95bf6-09e8-4f97-b6e6-7cb6383b3f4b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.235108 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.235757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.236041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.236317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.237036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.238682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20c30b-6ea5-4fd3-b6d4-dfb34793e5cb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.248717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1270/2544] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:28.252490 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.262783 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45bc1-083b-4e4a-864d-fe3589260f55 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.267382 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.268248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.268530 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.268807 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] PATH_INFO: `/v3/projects/0d6a0a68dbfd479983fe24827b99d3ac/users/ad91d1aaa54947cfa4b166381f3db1a9/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.284391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a0a68dbfd479983fe24827b99d3ac, user_id=ad91d1aaa54947cfa4b166381f3db1a9, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.287099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.300176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1275/2545] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:28 2022] PUT /identity/v3/projects/0d6a0a68dbfd479983fe24827b99d3ac/users/ad91d1aaa54947cfa4b166381f3db1a9/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:28.311488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.311778 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.312056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.339013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] MFA Rules not processed for user `ad91d1aaa54947cfa4b166381f3db1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:28.340213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:28.363891 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:28.407694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1271/2546] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:28.412821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.443822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:28.476757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56f90-72ed-4649-a771-0f241215da4b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.481417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.482103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.482388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.482662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.483350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.485237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.511038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1276/2547] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:28.515171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.526437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b955ba3-b056-4815-b692-9bd8e2122bea None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.581651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.582367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.582762 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.582930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.584240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.586199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.608721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1272/2548] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:28.610190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.620866 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd8fa-f127-42aa-8334-b72cedd2871a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.625632 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.626397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.626765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.627105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.627921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.629562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.641416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1277/2549] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:28.645506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.656205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f083de-1efc-4cf1-81f1-9c6048c3307c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.661086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.662128 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.662481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.662829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] PATH_INFO: `/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20/users/f67bc95cb79a4a87aa7efedfc89717c4/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.679307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c3ad48b4b04d2cacaf8dd77f908e20, user_id=f67bc95cb79a4a87aa7efedfc89717c4, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.682423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.704369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1273/2550] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:28 2022] PUT /identity/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20/users/f67bc95cb79a4a87aa7efedfc89717c4/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:28.704962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.719993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324eb3f-d058-4e4f-9ed5-df580e32007a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.786060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.786773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.787053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.787358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.788076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.789723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5905b-1c19-42b7-b8b1-c6e3ab5ee031 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.801198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1278/2551] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:28.805590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.816591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0082-662e-4f6b-9fb7-e73876753cc5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:28.822231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:28.823209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.823565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.823910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] PATH_INFO: `/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20/users/f67bc95cb79a4a87aa7efedfc89717c4/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.825917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c3ad48b4b04d2cacaf8dd77f908e20, user_id=f67bc95cb79a4a87aa7efedfc89717c4, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:28.828575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:28.840523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1274/2552] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:28 2022] PUT /identity/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20/users/f67bc95cb79a4a87aa7efedfc89717c4/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:28.850987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:28.851274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:28.854302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:28.878499 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] MFA Rules not processed for user `f67bc95cb79a4a87aa7efedfc89717c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:28.879688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:28.960293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1279/2553] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:28.971648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:28.973512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.043046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd7f0-4af4-4616-9a13-62bc2930d55f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.048068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.049659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.049813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.050652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.051003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.051466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.061494 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.063082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.073842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1275/2554] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:29.082329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:29.134478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d9e4d-fb26-403e-8ecf-67ef9e8e464a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.145465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.147175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.147462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.147785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] PATH_INFO: `/v3/users/cbfd55b6445e428082abda6cf9fe1782` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.149050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfd55b6445e428082abda6cf9fe1782)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.151257 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.151674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.161724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd11e-b734-4615-9cd7-0decbb19a675 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.168061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.168734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.169019 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.169290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.190913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:29.209736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfd55b6445e428082abda6cf9fe1782'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.210493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfd55b6445e428082abda6cf9fe1782'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.211117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfd55b6445e428082abda6cf9fe1782'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.218096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfd55b6445e428082abda6cf9fe1782'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.225857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-72ce108f-4625-4358-8e61-3aa3a1044997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfd55b6445e428082abda6cf9fe1782'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.235262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.236709 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.244014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1280/2555] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:29 2022] DELETE /identity/v3/users/cbfd55b6445e428082abda6cf9fe1782 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:29.246041 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1276/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:32:29.248314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.248682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.249032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.268617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:29.269828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.345823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1281/2557] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:29.353378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.355068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.425923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c23fbf-3df1-4f48-82fe-72a3de517406 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.489926 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.490606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.490892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.491169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.502780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.504343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64a025-2c00-4d24-a901-1f93ba0b2e32 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.515655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1277/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:29.548558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.550001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.561766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59960cb-c5c0-49da-8e8d-bcbc6c899153 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.566474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.567345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.567643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.568565 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] PATH_INFO: `/v3/users/ad91d1aaa54947cfa4b166381f3db1a9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.569771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad91d1aaa54947cfa4b166381f3db1a9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.571772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.618162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:29.625398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad91d1aaa54947cfa4b166381f3db1a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.626560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad91d1aaa54947cfa4b166381f3db1a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.627280 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad91d1aaa54947cfa4b166381f3db1a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.634753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad91d1aaa54947cfa4b166381f3db1a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.643950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad91d1aaa54947cfa4b166381f3db1a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.665425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1282/2559] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:29 2022] DELETE /identity/v3/users/ad91d1aaa54947cfa4b166381f3db1a9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:29.667568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.667853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.668129 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.686534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:29.687859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.750071 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1278/2560] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:29.760266 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.761838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.797392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.798830 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:29.812015 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed1379-9706-4570-b707-19be87fbfc92 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.816609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.817497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.817874 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.818115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] PATH_INFO: `/v3/projects/8e35037186b04f46b0b9b2cd511a22d7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.819677 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e35037186b04f46b0b9b2cd511a22d7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.821198 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.833540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:29.850215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb536b-c130-4fad-b300-be76eb71eb03 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:29.855398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:29.856103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:29.856413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:29.856765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:29.868025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:29.869663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:29.880372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1283/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:29.881827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e35037186b04f46b0b9b2cd511a22d7', 'request_id': 'req-9f00dbd6-22e1-4a9e-b578-29220954a631'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.890849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e35037186b04f46b0b9b2cd511a22d7', 'request_id': 'req-9f00dbd6-22e1-4a9e-b578-29220954a631'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.899644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e35037186b04f46b0b9b2cd511a22d7', 'request_id': 'req-9f00dbd6-22e1-4a9e-b578-29220954a631'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.914592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] The token cache is being invalidate because project 8e35037186b04f46b0b9b2cd511a22d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:29.914898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.915586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:29.917753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1279/2562] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:29 2022] DELETE /identity/v3/projects/8e35037186b04f46b0b9b2cd511a22d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:29.921595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:29.932722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c353-ad72-4aca-a897-ad77af01447e service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.028352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.029571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.029992 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.030337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] PATH_INFO: `/v3/users/2936c993818b45fe801ef8051d5e8dae` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.031797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2936c993818b45fe801ef8051d5e8dae)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.034456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.173448 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2936c993818b45fe801ef8051d5e8dae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.174379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2936c993818b45fe801ef8051d5e8dae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.174985 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2936c993818b45fe801ef8051d5e8dae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.182573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2936c993818b45fe801ef8051d5e8dae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.186233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:30.192210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2936c993818b45fe801ef8051d5e8dae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.212253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1284/2563] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:29 2022] DELETE /identity/v3/users/2936c993818b45fe801ef8051d5e8dae => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:30.288188 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.289785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.316073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dbd6-22e1-4a9e-b578-29220954a631 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.386099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.387056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.387345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.387624 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] PATH_INFO: `/v3/projects/0d6a0a68dbfd479983fe24827b99d3ac` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.388819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6a0a68dbfd479983fe24827b99d3ac)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.390806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.437970 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6a0a68dbfd479983fe24827b99d3ac', 'request_id': 'req-02bd7713-b706-4d6a-96b6-b449da337f71'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.443779 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6a0a68dbfd479983fe24827b99d3ac', 'request_id': 'req-02bd7713-b706-4d6a-96b6-b449da337f71'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.453964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6a0a68dbfd479983fe24827b99d3ac', 'request_id': 'req-02bd7713-b706-4d6a-96b6-b449da337f71'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.467757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] The token cache is being invalidate because project 0d6a0a68dbfd479983fe24827b99d3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:30.468042 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.468691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.470285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1280/2564] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:30 2022] DELETE /identity/v3/projects/0d6a0a68dbfd479983fe24827b99d3ac => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:30.474788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.476287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.489570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316fca-7b24-4f0f-ab8c-f9fff0b85a7c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.502716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.504152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.547422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:30.551619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.552699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.552982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.553283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] PATH_INFO: `/v3/users/f67bc95cb79a4a87aa7efedfc89717c4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.554497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67bc95cb79a4a87aa7efedfc89717c4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.556447 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.581799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd7713-b706-4d6a-96b6-b449da337f71 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.588020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.588892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.589270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.589644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] PATH_INFO: `/v3/projects/7e9f7bb9f6764e108be535db99124b7d` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.590912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9f7bb9f6764e108be535db99124b7d)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.593357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.609095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67bc95cb79a4a87aa7efedfc89717c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.609749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67bc95cb79a4a87aa7efedfc89717c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.610396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67bc95cb79a4a87aa7efedfc89717c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.618592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67bc95cb79a4a87aa7efedfc89717c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.626591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95c493ff-c5fa-4f4d-a0b0-d0fe6f38c47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67bc95cb79a4a87aa7efedfc89717c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.641217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9f7bb9f6764e108be535db99124b7d', 'request_id': 'req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.645485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1285/2565] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:30 2022] DELETE /identity/v3/users/f67bc95cb79a4a87aa7efedfc89717c4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:30.647770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9f7bb9f6764e108be535db99124b7d', 'request_id': 'req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.658412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9f7bb9f6764e108be535db99124b7d', 'request_id': 'req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.670407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] The token cache is being invalidate because project 7e9f7bb9f6764e108be535db99124b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:30.670701 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.671370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7458c72-2aa1-4de3-bfba-dbe6db3141c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:30.672977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1281/2566] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:30 2022] DELETE /identity/v3/projects/7e9f7bb9f6764e108be535db99124b7d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:30.677953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.678301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.678605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.697707 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:30.699412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.751037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:30.762904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1286/2567] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:30.770339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.770631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.771570 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.793150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:30.795405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.806182 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1282/2568] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:30.810160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.820573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7524a-fcc2-46df-9ac5-45310806d546 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.825315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.826193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.826534 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.826764 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.827635 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:30.827995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.829644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.842639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1287/2569] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:32:30.847066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.857266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaada4-0cf9-422c-ae08-e6fa6a18b944 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.862479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.863127 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.863412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.863689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.864392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.866374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:30.898243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1283/2570] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:30 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:30.899436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.909656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904447d-a41d-4af3-9103-a5058fb96788 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:30.922647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:30.924441 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:30.977937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:30.978819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:30.979105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:30.979518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:30.980522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:30.982244 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.004058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624a5c-8729-4676-a38c-9fbb4febd3c4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.010137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.011224 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.011763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.012223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] PATH_INFO: `/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.013337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1288/2571] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:30 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:31.014040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c3ad48b4b04d2cacaf8dd77f908e20)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.016057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.018825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.036334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fac32-c981-4e66-900c-a38f688a6a38 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.045331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.046412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.046870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.047239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.048461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.050474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.064794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1289/2572] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:31.065448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:31.069442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.077807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c3ad48b4b04d2cacaf8dd77f908e20', 'request_id': 'req-ab01d232-e52f-4084-a0ed-31c7df111b95'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:31.082358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2c973-189e-4e99-bb06-654dc24e8400 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.085117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c3ad48b4b04d2cacaf8dd77f908e20', 'request_id': 'req-ab01d232-e52f-4084-a0ed-31c7df111b95'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:31.097319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c3ad48b4b04d2cacaf8dd77f908e20', 'request_id': 'req-ab01d232-e52f-4084-a0ed-31c7df111b95'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:31.117126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] The token cache is being invalidate because project 20c3ad48b4b04d2cacaf8dd77f908e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:31.117495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:31.118554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-ab01d232-e52f-4084-a0ed-31c7df111b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:31.120187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1284/2573] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:30 2022] DELETE /identity/v3/projects/20c3ad48b4b04d2cacaf8dd77f908e20 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:31.126379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.126938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.127318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.153991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:31.155486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.170729 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.171676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.172190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.172653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.173546 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.175605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.195305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1290/2574] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:31.196265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.213369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.247826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1285/2575] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:31.254065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.254065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.263163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedffc63-74df-41cd-85cd-27974ed21ef4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.268095 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.268978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.269257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.269530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] PATH_INFO: `/v3/projects/f5bb8da534a14142bf59f3e6ee131c9b/users/5fcbac44fce94a69a03314599cb88d60/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.287456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:31.290168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bb8da534a14142bf59f3e6ee131c9b, user_id=5fcbac44fce94a69a03314599cb88d60, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.293010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858e93-8dff-46ae-808d-da38caff3ded admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.307329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973786e-17bd-4f63-ba26-aff64d8cd743 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.308838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1286/2576] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:31 2022] PUT /identity/v3/projects/f5bb8da534a14142bf59f3e6ee131c9b/users/5fcbac44fce94a69a03314599cb88d60/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:31.309755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b860-f8c3-464d-8c8c-9df2818c4359 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.310079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b860-f8c3-464d-8c8c-9df2818c4359 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.310360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b860-f8c3-464d-8c8c-9df2818c4359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.328938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-96e9b860-f8c3-464d-8c8c-9df2818c4359 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:31.330162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-96e9b860-f8c3-464d-8c8c-9df2818c4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.375452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.376001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.376288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.376566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.378412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.390893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.391569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1287/2577] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:31.392713 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.392853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.393069 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.393531 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.404525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1291/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:31.405401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.415606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86196a34-d405-4beb-8da3-78f23e4d4924 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.420753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.420935 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] MFA Rules not processed for user `5fcbac44fce94a69a03314599cb88d60`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:31.421400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.421682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.422002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.423051 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.423176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:31.423176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.424599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.436561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1292/2579] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:31.440908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.451446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160961a2-9c80-4cff-ab35-795e19abb14b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.456549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.457217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.457514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.457667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:31.457797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.459342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.461296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.488898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1293/2580] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:31.494001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.503489 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1288/2581] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:31.508460 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.518964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d4ac-5ecf-4793-a4ac-9b7d52c34b31 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.568456 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb55a-8774-4ca9-bf20-35455a6d727d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.574881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.575560 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.576016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.576307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.577000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.578974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.581260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.581948 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.582238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.582521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.583209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.585668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.601134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1294/2582] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:31.606016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.616966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1289/2583] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:31.619022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e857e-e8fe-44c9-9252-e0eae44b2111 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.621118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.661045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:31.688907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.689670 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.690004 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.690287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.691017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.691559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8119-b617-4fb1-8014-d9d42932e460 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.693339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.697716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.698511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.698861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.699144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.699838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.701954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.703583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1295/2584] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:31.707906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.718282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32676604-cfdd-4b5e-9061-80cf9a612d0d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.725067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1290/2585] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:31.725217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.725217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.725217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.725217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.725602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.726434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.726822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.736334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a767f0-1267-44fc-bea6-a57d29e67284 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.740758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1296/2586] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:31.741993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.742335 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.743247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.743529 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.743802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.744524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.746138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.752069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec800d-443f-41ed-8ad5-e7311cebc0d2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.757370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1291/2587] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:31.757507 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.758478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.758765 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.759047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] PATH_INFO: `/v3/projects/87cced3cc51e4506bbc9138ac58a1125/users/dc2e592fb7ce4b8f88ba27e8aa532a3a/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.761010 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.770504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25268-04d4-48b6-83ea-d5c51b3b1970 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.774084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cced3cc51e4506bbc9138ac58a1125, user_id=dc2e592fb7ce4b8f88ba27e8aa532a3a, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.775539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.776407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.776690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.776794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c86e46-9d58-4156-bc98-f56c96930435 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.776966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] PATH_INFO: `/v3/projects/cee6d430a4ab48fca79b1463e9217607/users/861097d1e1aa476597b95a9246e47184/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.789639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1297/2588] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:31 2022] PUT /identity/v3/projects/87cced3cc51e4506bbc9138ac58a1125/users/dc2e592fb7ce4b8f88ba27e8aa532a3a/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:31.791946 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6d430a4ab48fca79b1463e9217607, user_id=861097d1e1aa476597b95a9246e47184, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.794817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.800873 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.801164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.801444 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.808537 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1292/2589] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:31 2022] PUT /identity/v3/projects/cee6d430a4ab48fca79b1463e9217607/users/861097d1e1aa476597b95a9246e47184/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:31.812378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.822338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:31.829820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] MFA Rules not processed for user `dc2e592fb7ce4b8f88ba27e8aa532a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:31.831064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.876687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f12a46-12fc-4fc8-b15d-1b06f7f23432 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.888620 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.889291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.889577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.889852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.890605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.892204 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.905336 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1298/2590] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:31.905861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1293/2591] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:31.906648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.912797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:31.914496 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:31.917457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48856-fe19-41aa-9dd3-8687b838c5a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.922193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:31.923064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.923346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.923620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] PATH_INFO: `/v3/projects/cee6d430a4ab48fca79b1463e9217607/users/861097d1e1aa476597b95a9246e47184/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.926098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6d430a4ab48fca79b1463e9217607, user_id=861097d1e1aa476597b95a9246e47184, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:31.929322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e985-74c9-47a1-a086-6f53dc9cc5d3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:31.939683 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1299/2592] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:31 2022] PUT /identity/v3/projects/cee6d430a4ab48fca79b1463e9217607/users/861097d1e1aa476597b95a9246e47184/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:31.951622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:31.951913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:31.952188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:31.977229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454786-e79c-4654-a32b-93dc2aab0152 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:31.979313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] MFA Rules not processed for user `861097d1e1aa476597b95a9246e47184`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:31.980514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.026664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.027318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.027623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.027895 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.047679 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:32.055892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1300/2593] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:32.063594 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.064970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.078272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b185-d2ed-4090-8077-e85446224f88 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.082184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.082827 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.083112 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.083951 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.086139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.087580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.093493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.094953 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.096717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1294/2594] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:32:32.104676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1301/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:32:32.117480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.137110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:32.179638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.184308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a45f-c365-4324-abf5-81b0a3e30aa2 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.188136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d62f0-c2db-46a6-abb2-9ca0431da21d service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.188873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.189735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.190040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.190311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] PATH_INFO: `/v3/users/dc2e592fb7ce4b8f88ba27e8aa532a3a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.191497 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2e592fb7ce4b8f88ba27e8aa532a3a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.192007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.193234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.193518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.193794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.194086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.245993 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2e592fb7ce4b8f88ba27e8aa532a3a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.247243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2e592fb7ce4b8f88ba27e8aa532a3a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.247651 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2e592fb7ce4b8f88ba27e8aa532a3a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.261151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.262426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2e592fb7ce4b8f88ba27e8aa532a3a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.262617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c36404-60d2-49b9-ba56-5488f3aff47c service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.269949 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2e592fb7ce4b8f88ba27e8aa532a3a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.272899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1302/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:32.296755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0c67-56d7-4deb-86f5-a49a6ba49912 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.297050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0c67-56d7-4deb-86f5-a49a6ba49912 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.297329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0c67-56d7-4deb-86f5-a49a6ba49912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.298975 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1295/2597] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:32 2022] DELETE /identity/v3/users/dc2e592fb7ce4b8f88ba27e8aa532a3a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:32.327365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c24f0c67-56d7-4deb-86f5-a49a6ba49912 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:32.328621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c24f0c67-56d7-4deb-86f5-a49a6ba49912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.410398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1303/2598] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:32.420475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.422225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.491680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54546-b2d2-4caf-984d-5e7bf1e3a465 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.495906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.496558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.496839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.497118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.507214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.508655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.518110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1296/2599] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:32.720228 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.720549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.720825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.738457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:32.740182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.798452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1304/2600] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:32.804781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.806559 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.812882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:32.814515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.821979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275a6a-9163-4570-8c11-7a496228fa1e service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.827711 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.828667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.829018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.829368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] PATH_INFO: `/v3/projects/87cced3cc51e4506bbc9138ac58a1125` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.831329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cced3cc51e4506bbc9138ac58a1125)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:32.833280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:32.850700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:32.870900 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:32.884101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cced3cc51e4506bbc9138ac58a1125', 'request_id': 'req-33880269-db2d-4b11-ae7c-99e0aa36ed54'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.889388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ed28-36e5-4fc9-b634-04919e2f8c83 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:32.889853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cced3cc51e4506bbc9138ac58a1125', 'request_id': 'req-33880269-db2d-4b11-ae7c-99e0aa36ed54'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.899351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cced3cc51e4506bbc9138ac58a1125', 'request_id': 'req-33880269-db2d-4b11-ae7c-99e0aa36ed54'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.910583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] The token cache is being invalidate because project 87cced3cc51e4506bbc9138ac58a1125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:32.910871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.912025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-33880269-db2d-4b11-ae7c-99e0aa36ed54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:32.913563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1297/2601] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:32 2022] DELETE /identity/v3/projects/87cced3cc51e4506bbc9138ac58a1125 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:32.918737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba410-e527-409b-a6cf-47d2846da697 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.919033 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba410-e527-409b-a6cf-47d2846da697 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.919344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba410-e527-409b-a6cf-47d2846da697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.937693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-1e0ba410-e527-409b-a6cf-47d2846da697 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:32.938956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1e0ba410-e527-409b-a6cf-47d2846da697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:32.950233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:32.950883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:32.951161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:32.951439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:32.953223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:33.000231 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1298/2602] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:33.007772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.008063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.008341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.012147 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.013821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.023848 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1305/2603] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:32:33.027212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:33.028416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:33.036980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1299/2604] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:33.041031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.051983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f56109-47ba-4fbe-ab83-2e14aec56f47 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.057213 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.057820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.058133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.058407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.059142 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:33.059451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.061091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.073325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1306/2605] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:32:33.078944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.088815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b1ec-888e-45f1-8fe1-df2d2f56ce54 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.093747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.094437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.094718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.094991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.095676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.097770 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.133247 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1300/2606] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:33 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:33.133821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.144028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef8b9-98f4-445a-b87d-44a35eba4c9e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.209312 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.210114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.210291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.210603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.211246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.213163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.221300 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:33.235557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1307/2607] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:33 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:33.240424 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.251236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6dc96-5218-4784-ba87-67359ca31107 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.258668 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.259849 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.260369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.260834 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.261715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.263534 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.275941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1301/2608] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:33.282169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.294163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adcb72-a7fe-481c-b4ab-01829b1ffaf0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.299333 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.299994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.300274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.300545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.301301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.303455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587900-2854-44c7-a841-f2928939d6c4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.315847 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1308/2609] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:33.320846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.331835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff105-cfde-4821-b9c8-17e2844c10be admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.336564 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.337445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.337723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.338030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] PATH_INFO: `/v3/projects/1410bbb0b57642598cba3d703d2d4969/users/6bb2a938a35e455888bd8c3a132f5a76/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.353309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1410bbb0b57642598cba3d703d2d4969, user_id=6bb2a938a35e455888bd8c3a132f5a76, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.356212 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.373101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1302/2610] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:33 2022] PUT /identity/v3/projects/1410bbb0b57642598cba3d703d2d4969/users/6bb2a938a35e455888bd8c3a132f5a76/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:33.385123 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.385350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.385648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.414690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] MFA Rules not processed for user `6bb2a938a35e455888bd8c3a132f5a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:33.415884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:33.501970 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1309/2611] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:33.511757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:33.513692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:33.585600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566187e-3fee-4812-99a2-ddb6b810319e admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:33.591629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:33.592293 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:33.592569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:33.592838 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:33.603943 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:33.605423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af4d0-a288-40a5-89d6-d13eb6d57f90 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:33.611193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:33.620162 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1303/2612] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:39.081780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:39.083205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:39.151595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23f51-42f6-4a01-b17a-eaed94d62581 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:39.156001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:39.156875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:39.157160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:39.157438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] PATH_INFO: `/v3/users/5fcbac44fce94a69a03314599cb88d60` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:39.158656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcbac44fce94a69a03314599cb88d60)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:39.160570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:39.210690 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcbac44fce94a69a03314599cb88d60'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.211274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcbac44fce94a69a03314599cb88d60'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.211884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcbac44fce94a69a03314599cb88d60'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.220535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcbac44fce94a69a03314599cb88d60'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.228099 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcbac44fce94a69a03314599cb88d60'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.235286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:39.253967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1310/2613] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:39 2022] DELETE /identity/v3/users/5fcbac44fce94a69a03314599cb88d60 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:39.254252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:39.254252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:39.254252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:39.272280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:39.273561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:39.334539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1304/2614] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:39.343890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:39.345283 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:39.402600 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bb838-eaa6-442b-9ba5-12405711422b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:39.406289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:39.406930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:39.407235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:39.407465 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:39.416883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:39.418340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:39.428332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1311/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:39.704340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:39.705865 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:39.719393 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f10d4-0114-4574-829d-856316322fe7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:39.725608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:39.726772 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:39.727132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:39.727427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] PATH_INFO: `/v3/projects/f5bb8da534a14142bf59f3e6ee131c9b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:39.730973 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bb8da534a14142bf59f3e6ee131c9b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:39.733226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:39.788048 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bb8da534a14142bf59f3e6ee131c9b', 'request_id': 'req-80de5d53-217b-4258-9a15-9b2f93f66748'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.793886 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bb8da534a14142bf59f3e6ee131c9b', 'request_id': 'req-80de5d53-217b-4258-9a15-9b2f93f66748'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.804352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bb8da534a14142bf59f3e6ee131c9b', 'request_id': 'req-80de5d53-217b-4258-9a15-9b2f93f66748'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.815813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] The token cache is being invalidate because project f5bb8da534a14142bf59f3e6ee131c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:39.816165 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.817002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.818567 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1305/2616] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:39 2022] DELETE /identity/v3/projects/f5bb8da534a14142bf59f3e6ee131c9b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:39.822751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:39.833310 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90565c-73ef-4b42-b955-efe09b52e2c0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:39.893236 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:39.894217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:39.894566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:39.894923 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] PATH_INFO: `/v3/users/861097d1e1aa476597b95a9246e47184` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:39.896825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861097d1e1aa476597b95a9246e47184)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:39.898715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:39.947532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861097d1e1aa476597b95a9246e47184'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.948362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861097d1e1aa476597b95a9246e47184'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.948956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861097d1e1aa476597b95a9246e47184'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.955879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861097d1e1aa476597b95a9246e47184'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.966372 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-24df4fe6-ccc9-430c-975f-4da3815dff90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861097d1e1aa476597b95a9246e47184'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:39.984284 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1312/2617] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:39 2022] DELETE /identity/v3/users/861097d1e1aa476597b95a9246e47184 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:40.276448 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.277927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:40.291170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5d53-217b-4258-9a15-9b2f93f66748 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.349488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.350388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.350675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.350960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] PATH_INFO: `/v3/projects/cee6d430a4ab48fca79b1463e9217607` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.352151 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee6d430a4ab48fca79b1463e9217607)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.354083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.384729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:40.403277 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee6d430a4ab48fca79b1463e9217607', 'request_id': 'req-72a70f7d-7c1d-45e7-bb86-bb0225113b29'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:40.409185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee6d430a4ab48fca79b1463e9217607', 'request_id': 'req-72a70f7d-7c1d-45e7-bb86-bb0225113b29'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:40.417065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee6d430a4ab48fca79b1463e9217607', 'request_id': 'req-72a70f7d-7c1d-45e7-bb86-bb0225113b29'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:40.428471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] The token cache is being invalidate because project cee6d430a4ab48fca79b1463e9217607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:40.428757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:40.429404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-72a70f7d-7c1d-45e7-bb86-bb0225113b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:40.430959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1306/2618] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:40 2022] DELETE /identity/v3/projects/cee6d430a4ab48fca79b1463e9217607 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:40.435808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.436281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.436380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.454069 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:40.455296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:40.460417 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:40.516245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1313/2619] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:40.523862 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.524147 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.524417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.542638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:40.543827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:40.553518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1307/2620] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:40.557483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.567884 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab2b89-57f0-4455-b1e3-56f23312771b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.572556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.573216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.573495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.573767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.574562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:40.574861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.576513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.589563 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1314/2621] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:40.593704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.603733 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408547ab-263f-466b-92cb-1d40e1e61f1d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.608440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.609093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.609376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.609727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.610469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.612356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.642318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1308/2622] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:40.643472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.654098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9082f-c954-4a49-99f6-6a32b9317bbb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.712823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.713497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.713775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.714079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.714901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.717787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.739422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1315/2623] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:40.743491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.753656 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b19f9-0404-4a45-bdf6-7e9581a68db7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.760263 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.760941 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.761222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.761503 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.762254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.763857 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.775467 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1309/2624] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:40.779395 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.790313 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6986d-f5d6-4202-b0bf-288848394780 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.794936 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.795593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.795871 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.796139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.796858 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.798513 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb1c2-20ed-4b49-9096-d7b4b1b2e798 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.808896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1316/2625] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:40.813294 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:40.823578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d46ca-292f-4afa-af93-0263d4667330 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:40.828407 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:40.829284 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.829565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.829836 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] PATH_INFO: `/v3/projects/aa22fd5afd384c128440b6ed22287e6d/users/aeddb35a09254ee9866c5fef8a32db9a/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.845099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa22fd5afd384c128440b6ed22287e6d, user_id=aeddb35a09254ee9866c5fef8a32db9a, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:40.847792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:40.863560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1310/2626] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:40 2022] PUT /identity/v3/projects/aa22fd5afd384c128440b6ed22287e6d/users/aeddb35a09254ee9866c5fef8a32db9a/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:40.875293 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:40.876038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:40.876038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:40.902898 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] MFA Rules not processed for user `aeddb35a09254ee9866c5fef8a32db9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:40.904159 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:40.968975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1317/2627] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:40.973449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.039067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdd-37b9-4319-9af2-e67831ee4b33 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.043737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.044621 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.045001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.045334 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.046155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.048103 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.076903 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1311/2628] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:40 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:41.078172 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.089508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b5a5-f783-4571-9085-36fa4f0c0998 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.093394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:41.158661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.159661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.159661 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.159862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.160548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.162977 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.185572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1318/2629] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:41 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:41.189549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.203577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ea0b-4d60-44d5-a439-6c74e6a6563b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.210504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.211274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.211600 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.211879 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.212602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.214222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.226423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1312/2630] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:41.230999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.243120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d296ee-f17d-4ede-9f47-4e8344f8ce6e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.247949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.248833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.249129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.249401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] PATH_INFO: `/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3/users/ea72ad4a7f594863b4b2cc62376cd811/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.265660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef63b5d93c7d486c8006f43d11ead2b3, user_id=ea72ad4a7f594863b4b2cc62376cd811, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.268368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.281547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1319/2631] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:41 2022] PUT /identity/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3/users/ea72ad4a7f594863b4b2cc62376cd811/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:41.285601 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.295971 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f35108-4e75-4414-8108-8ffbb21614a0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.316805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:41.364057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.364759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.365045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.365319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.366141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.368018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50056952-e29b-4bcd-bae7-d1904e26a4c3 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.379673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1313/2632] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:41.384796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.395240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd35ada-69c4-4650-8690-2787838accd2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.400648 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.401523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.401829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.402130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] PATH_INFO: `/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3/users/ea72ad4a7f594863b4b2cc62376cd811/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.404086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef63b5d93c7d486c8006f43d11ead2b3, user_id=ea72ad4a7f594863b4b2cc62376cd811, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.406743 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.417087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1320/2633] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:41 2022] PUT /identity/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3/users/ea72ad4a7f594863b4b2cc62376cd811/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:41.427828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.428117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.428390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.455759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] MFA Rules not processed for user `ea72ad4a7f594863b4b2cc62376cd811`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:41.457040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:41.529504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1314/2634] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:41.541569 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.543277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:41.600014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597cfe7-1e06-4371-a1bb-e1997807f1a0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.603602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.604247 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.604535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.604814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.614711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.617168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.628005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1321/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:41.925992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.935940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b3da-f422-4077-9d5b-923a7c6ca4fe None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.940214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea72ad4a7f594863b4b2cc62376cd811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef63b5d93c7d486c8006f43d11ead2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.940860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.941143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.941426 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.942178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:41.942521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.944092 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:41.955544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1315/2636] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:41.959489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:41.968593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb591-75bc-47bd-a095-9e6e96ee5f49 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:41.973254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea72ad4a7f594863b4b2cc62376cd811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef63b5d93c7d486c8006f43d11ead2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:41.974583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:41.974865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:41.975136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:41.975839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:41.977698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:42.002968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1322/2637] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:41 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:42.007155 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:42.016962 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752a4c7-6475-4ea4-b22f-17b2b5e0480d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:42.072173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea72ad4a7f594863b4b2cc62376cd811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef63b5d93c7d486c8006f43d11ead2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:42.072818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:42.073100 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:42.073375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:42.074111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:42.074416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:42.075992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:42.087047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1316/2638] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:42.122944 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:42.133880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3ca9c-7591-41d9-b2e0-84fe01ab2d6a tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:42.139340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea72ad4a7f594863b4b2cc62376cd811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef63b5d93c7d486c8006f43d11ead2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:42.140226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:42.140519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:42.140795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] PATH_INFO: `/v3/projects/149cf064367f47b7841ecf86a0abb7e8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:42.142053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorizing `identity:delete_project(project_id=149cf064367f47b7841ecf86a0abb7e8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:42.143966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:42.181055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:42.192352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149cf064367f47b7841ecf86a0abb7e8', 'request_id': 'req-56a91bd5-bd84-4e73-a6f9-e37284335b8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.197817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149cf064367f47b7841ecf86a0abb7e8', 'request_id': 'req-56a91bd5-bd84-4e73-a6f9-e37284335b8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.204320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149cf064367f47b7841ecf86a0abb7e8', 'request_id': 'req-56a91bd5-bd84-4e73-a6f9-e37284335b8d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.217451 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] The token cache is being invalidate because project 149cf064367f47b7841ecf86a0abb7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:42.217740 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.218415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-56a91bd5-bd84-4e73-a6f9-e37284335b8d tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.219937 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1323/2639] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:42 2022] DELETE /identity/v3/projects/149cf064367f47b7841ecf86a0abb7e8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:42.421249 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:42.423002 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:42.454443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=100 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:42.491145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c534-f5d9-4d0d-b27c-8ef8555892d0 tempest-VolumeQuotaClassesTest-1885930314 tempest-VolumeQuotaClassesTest-1885930314-project-admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:42.554337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:42.555201 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:42.555476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:42.555742 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] PATH_INFO: `/v3/users/aeddb35a09254ee9866c5fef8a32db9a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:42.556905 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeddb35a09254ee9866c5fef8a32db9a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:42.558852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:42.605459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeddb35a09254ee9866c5fef8a32db9a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.606250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeddb35a09254ee9866c5fef8a32db9a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.606868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeddb35a09254ee9866c5fef8a32db9a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.619055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeddb35a09254ee9866c5fef8a32db9a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.628524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeddb35a09254ee9866c5fef8a32db9a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:42.641693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1317/2640] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:42 2022] DELETE /identity/v3/users/aeddb35a09254ee9866c5fef8a32db9a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:42.646891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:42.647374 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:42.647497 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:42.666455 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:42.667657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:42.727570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1324/2641] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:42.737228 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:42.738642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:42.795145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4776ef-7074-4958-8aab-21a2aa5c7661 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:42.798721 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:42.799357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:42.799635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:42.799903 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:42.806659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:42.809004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:42.810807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:42.822549 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1318/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:43.084306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.085832 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.098091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf5c-ed1a-4784-8cf2-94487166d2b1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.102854 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.103719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.103998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.104272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] PATH_INFO: `/v3/projects/aa22fd5afd384c128440b6ed22287e6d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.105443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa22fd5afd384c128440b6ed22287e6d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.107376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.154651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa22fd5afd384c128440b6ed22287e6d', 'request_id': 'req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.160059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa22fd5afd384c128440b6ed22287e6d', 'request_id': 'req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.166166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa22fd5afd384c128440b6ed22287e6d', 'request_id': 'req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.178506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] The token cache is being invalidate because project aa22fd5afd384c128440b6ed22287e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:43.178799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.179434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.181019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1325/2643] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:43 2022] DELETE /identity/v3/projects/aa22fd5afd384c128440b6ed22287e6d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:43.185124 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.195337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791211da-5d35-462d-81b4-d3095014ea90 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.251058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.251917 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.252194 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.252464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] PATH_INFO: `/v3/users/ea72ad4a7f594863b4b2cc62376cd811` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.253713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea72ad4a7f594863b4b2cc62376cd811)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.256305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.301471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea72ad4a7f594863b4b2cc62376cd811'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.302747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea72ad4a7f594863b4b2cc62376cd811'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.303360 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea72ad4a7f594863b4b2cc62376cd811'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.320744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea72ad4a7f594863b4b2cc62376cd811'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.327590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5175d8fe-a9de-49d1-bfa9-8cdb2be41fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea72ad4a7f594863b4b2cc62376cd811'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.339938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1319/2644] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:43 2022] DELETE /identity/v3/users/ea72ad4a7f594863b4b2cc62376cd811 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:43.427556 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.429031 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.442692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c60e66-f5ad-4ace-bd21-9a5b226bf89f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.489039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:43.506427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.507307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.507930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.507930 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] PATH_INFO: `/v3/users/6bb2a938a35e455888bd8c3a132f5a76` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.509043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb2a938a35e455888bd8c3a132f5a76)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.511048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.558674 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb2a938a35e455888bd8c3a132f5a76'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.559321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb2a938a35e455888bd8c3a132f5a76'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.559921 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb2a938a35e455888bd8c3a132f5a76'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.567002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb2a938a35e455888bd8c3a132f5a76'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.574540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb2a938a35e455888bd8c3a132f5a76'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.599029 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1326/2645] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:43 2022] DELETE /identity/v3/users/6bb2a938a35e455888bd8c3a132f5a76 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:43.601082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.601545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.601641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.623404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:43.624541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.624692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.626126 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.689681 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1320/2646] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:43.697932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb6a9-21cb-4dd1-9792-25b04db4bd0f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.698884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.700280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.702656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.703548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.703829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.704105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] PATH_INFO: `/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.705424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef63b5d93c7d486c8006f43d11ead2b3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.707399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.720117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:43.761549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef63b5d93c7d486c8006f43d11ead2b3', 'request_id': 'req-a1f08582-02d1-48d0-b80c-ba87ddac3417'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.763049 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e0600-ad06-4c07-83f7-dfacbae8d63b None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.767318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef63b5d93c7d486c8006f43d11ead2b3', 'request_id': 'req-a1f08582-02d1-48d0-b80c-ba87ddac3417'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.774405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef63b5d93c7d486c8006f43d11ead2b3', 'request_id': 'req-a1f08582-02d1-48d0-b80c-ba87ddac3417'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.778102 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:43.790901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] The token cache is being invalidate because project ef63b5d93c7d486c8006f43d11ead2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:43.791390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.792436 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a1f08582-02d1-48d0-b80c-ba87ddac3417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:43.794378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1327/2647] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:43 2022] DELETE /identity/v3/projects/ef63b5d93c7d486c8006f43d11ead2b3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:43.798727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fefee-b6ff-4602-a91e-8349e0a7f966 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.799016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fefee-b6ff-4602-a91e-8349e0a7f966 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.799296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fefee-b6ff-4602-a91e-8349e0a7f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.816887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.817551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.817832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.818138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.818731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-299fefee-b6ff-4602-a91e-8349e0a7f966 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:43.819909 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-299fefee-b6ff-4602-a91e-8349e0a7f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.820088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.886731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1328/2648] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:43.894278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.894573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.894853 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.896540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.898025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.908253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1321/2649] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:32:43.914533 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:43.915818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:43.924295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1329/2650] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:43.928560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.939066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa698-0128-446a-ac5b-dccc7ed87220 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.944290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.944899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.945185 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.945463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.946245 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:43.946552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.948172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:43.961475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1322/2651] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:43.965671 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:43.975978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172f0f-228e-43a5-998b-951d72ed85f4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:43.982205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:43.982882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:43.983175 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:43.983467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:43.984277 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:43.986346 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.016062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1330/2652] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:43 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:44.020331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.030913 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffe80-bdba-4403-93f7-ff060e693f49 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.098819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.099495 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.099780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.100055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.100751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.102698 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.118251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:44.126392 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1323/2653] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:44.131557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.144077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72861394-bbe0-4151-a74e-97f202c6ea51 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.149708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.150418 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.150704 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.150979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.151716 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.153399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.164353 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1331/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:44.168342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.181411 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874a81c-45ae-4dd8-8797-52b61a68f9fd admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.189653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.189653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.189653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.189653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.190035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.190762 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.193059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.193273 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.203777 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1324/2655] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:44.207821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.218700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50bcc-0b3a-416e-937d-084693fbc35d admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.223242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16e672-af79-41ff-a5f1-1239e8ec1b5f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.223521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.224405 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.224691 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.224966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] PATH_INFO: `/v3/projects/127a4b441e5747b894b8d49c5ae24369/users/ce40d9945f0c4adb998caf9fc30bf652/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.228128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.228991 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.229272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.229541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] PATH_INFO: `/v3/projects/1410bbb0b57642598cba3d703d2d4969` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.230812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1410bbb0b57642598cba3d703d2d4969)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.232727 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.240265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a4b441e5747b894b8d49c5ae24369, user_id=ce40d9945f0c4adb998caf9fc30bf652, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.243222 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a00bf-b9a6-4fc9-8371-54973dc79387 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.257498 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1325/2656] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:44 2022] PUT /identity/v3/projects/127a4b441e5747b894b8d49c5ae24369/users/ce40d9945f0c4adb998caf9fc30bf652/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:44.283771 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1410bbb0b57642598cba3d703d2d4969', 'request_id': 'req-15102e3d-c312-4fc5-9c75-3af396e75955'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:44.291035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1410bbb0b57642598cba3d703d2d4969', 'request_id': 'req-15102e3d-c312-4fc5-9c75-3af396e75955'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:44.298153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1410bbb0b57642598cba3d703d2d4969', 'request_id': 'req-15102e3d-c312-4fc5-9c75-3af396e75955'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:44.320767 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] The token cache is being invalidate because project 1410bbb0b57642598cba3d703d2d4969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:44.321062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:44.321852 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-15102e3d-c312-4fc5-9c75-3af396e75955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:44.323496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1332/2657] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:44 2022] DELETE /identity/v3/projects/1410bbb0b57642598cba3d703d2d4969 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:44.326908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.326908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.326908 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.328043 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bd90-957b-4a5d-8553-b87ce498e9eb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.328330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bd90-957b-4a5d-8553-b87ce498e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.328605 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bd90-957b-4a5d-8553-b87ce498e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.346779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4be1bd90-957b-4a5d-8553-b87ce498e9eb None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:44.348071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4be1bd90-957b-4a5d-8553-b87ce498e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.355205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] MFA Rules not processed for user `ce40d9945f0c4adb998caf9fc30bf652`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:44.356373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.383361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:44.412219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1333/2658] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:44.419733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.420093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.420408 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.424093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1326/2659] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:44.428870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.430213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.439494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:44.440678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.443998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dba2a3-be30-4ab8-a801-14369e2ed0e4 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.448716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.449161 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1334/2660] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:44.449291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.449569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.450014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.450697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.452574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.453104 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.461717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f082-0e68-4212-a71f-ad1fdfb9fe3e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.466325 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.466959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.467253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.467508 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.468225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:44.468531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.470358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.481101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1327/2661] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:44.482825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.485101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1335/2662] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:32:44.490059 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.499894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e691-6dd7-4b1f-ac78-020dd80a3543 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.547774 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdf60f-0947-459a-a210-823d6bf16e7b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.552921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.553584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.553921 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.554217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.554898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.556804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.557281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.557954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.558234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.558504 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.559176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.561086 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.579515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1328/2663] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:44.583980 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.591079 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1336/2664] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:44.591982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.593876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff99fcc-ec68-459f-b7f8-675b3d6e1237 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.610213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:44.651156 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.651829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.652110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.652384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.653134 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.654816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.655068 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887eb74-438a-402c-b844-4339418ea9c5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.659772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.660435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.660720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.661046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.661731 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.663662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.664613 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1329/2665] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:44.668757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.679235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dae9e-e511-4163-befb-849233a055fc admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.684087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.684988 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.685274 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.685554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] PATH_INFO: `/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1/users/fdd565c4ef954347b9712a2b84acd865/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.686139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1337/2666] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:44.690666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.700901 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d609-232d-4e0b-a9b4-bc639eca6856 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.703694 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6d8e17f3f4995b2ef2db59e0772c1, user_id=fdd565c4ef954347b9712a2b84acd865, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.705422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.706107 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.706386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.706488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.706655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.707524 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.709120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.722843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1338/2667] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:44.723025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1330/2668] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:44 2022] PUT /identity/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1/users/fdd565c4ef954347b9712a2b84acd865/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:44.724259 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.724444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.734005 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02d02-b95e-4a17-90f0-eb95a57ff40e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.755638 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:44.789641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0bfc6-518e-405a-ba41-b14ab67fb277 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.792165 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.792829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.793111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.793412 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.794168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.794440 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.795099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.795377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.795652 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.795761 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.796517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.798123 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.806265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1339/2669] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:44.811909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1331/2670] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:44.812072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.813137 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.819947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86edc1-61c4-4b50-bdb8-3f6579a83493 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.824956 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd53480-773f-4310-adc0-b6cc7cbad211 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:44.825205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.826115 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.826398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.826678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] PATH_INFO: `/v3/projects/a884d8dbb15b401fb19dd6701b1e753a/users/85d2a96d011342eb8c1244262a1f6667/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.829847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:44.830795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.831081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.831344 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] PATH_INFO: `/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1/users/fdd565c4ef954347b9712a2b84acd865/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.833276 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6d8e17f3f4995b2ef2db59e0772c1, user_id=fdd565c4ef954347b9712a2b84acd865, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.835909 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d901dd-413a-4dff-949e-099f5dcbf513 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.842007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a884d8dbb15b401fb19dd6701b1e753a, user_id=85d2a96d011342eb8c1244262a1f6667, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:44.844630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d805c-05f5-4e9c-ad42-f5e5693076e6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:44.846429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1332/2671] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:44 2022] PUT /identity/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1/users/fdd565c4ef954347b9712a2b84acd865/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:44.857942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.858241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.858380 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1340/2672] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:44 2022] PUT /identity/v3/projects/a884d8dbb15b401fb19dd6701b1e753a/users/85d2a96d011342eb8c1244262a1f6667/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:44.861939 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.869014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:44.869330 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:44.869607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:44.889301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] MFA Rules not processed for user `fdd565c4ef954347b9712a2b84acd865`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:44.890571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.895139 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] MFA Rules not processed for user `85d2a96d011342eb8c1244262a1f6667`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:44.896359 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.956313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:44.959344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1341/2673] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:44.961944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1333/2674] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:44.969961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.971462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:44.972484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:44.974383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:45.031477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7846d7-2297-4541-98c8-13e787c750ee None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:45.031697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4f41-910c-456a-b256-aedfcceab481 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:45.035073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:45.035252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:45.035712 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:45.036432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:45.036559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:45.036737 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:45.036862 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:45.037178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:45.045038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:45.046174 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:45.046496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:45.047630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:45.056318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1342/2675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:45.059387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1334/2676] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:45.129114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:45.139817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0dded-6707-4c52-bd0e-c5026b909465 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:45.143629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:45.144267 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:45.144549 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:45.144817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:45.171736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:45.205538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:45.207083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254215e-718b-4c5f-8d38-b12c4983e752 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:45.217541 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1343/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:49.242835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:49.304149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afad2b7-a64d-4dc9-80a3-1d59664acc6e service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:49.308759 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:49.309635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:49.309933 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:49.310229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] PATH_INFO: `/v3/users/ce40d9945f0c4adb998caf9fc30bf652` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:49.311446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce40d9945f0c4adb998caf9fc30bf652)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:49.313386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:49.359031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce40d9945f0c4adb998caf9fc30bf652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.359629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce40d9945f0c4adb998caf9fc30bf652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.360233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce40d9945f0c4adb998caf9fc30bf652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.372085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce40d9945f0c4adb998caf9fc30bf652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.378785 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce40d9945f0c4adb998caf9fc30bf652'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.391333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1335/2678] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:49 2022] DELETE /identity/v3/users/ce40d9945f0c4adb998caf9fc30bf652 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:49.396430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:49.396888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:49.396982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:49.413627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:49.414835 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:49.471842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1344/2679] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:49.481425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:49.482813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:49.509457 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:49.541462 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8f0f-9d4e-4ee7-bfc7-4c5bb7418098 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:49.545059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:49.545714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:49.546037 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:49.546323 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:49.555169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:49.556592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:49.566011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1336/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:49.826204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:49.827819 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:49.842686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0f0fe-dfb0-4eea-bd54-43a63af6252a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:49.848296 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:49.849844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:49.850095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:49.850419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] PATH_INFO: `/v3/projects/127a4b441e5747b894b8d49c5ae24369` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:49.851768 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127a4b441e5747b894b8d49c5ae24369)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:49.853804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:49.901037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127a4b441e5747b894b8d49c5ae24369', 'request_id': 'req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.906654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127a4b441e5747b894b8d49c5ae24369', 'request_id': 'req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.913460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127a4b441e5747b894b8d49c5ae24369', 'request_id': 'req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.925462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] The token cache is being invalidate because project 127a4b441e5747b894b8d49c5ae24369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:49.925809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.926474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:49.928023 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1345/2681] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:49 2022] DELETE /identity/v3/projects/127a4b441e5747b894b8d49c5ae24369 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:49.932368 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:49.941918 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764633-360b-43e0-9d98-438a9238e523 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.001877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.002788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.003073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.003349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] PATH_INFO: `/v3/users/fdd565c4ef954347b9712a2b84acd865` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.005186 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd565c4ef954347b9712a2b84acd865)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.007120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.057384 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd565c4ef954347b9712a2b84acd865'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.058164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd565c4ef954347b9712a2b84acd865'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.058684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd565c4ef954347b9712a2b84acd865'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.072704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd565c4ef954347b9712a2b84acd865'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.079345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-6f5e1013-96b7-455d-b66d-59815c953d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd565c4ef954347b9712a2b84acd865'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.093726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1337/2682] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:49 2022] DELETE /identity/v3/users/fdd565c4ef954347b9712a2b84acd865 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:50.379931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.382498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:50.402640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada9ea4-21a9-4e85-9167-b0a96ef8ae71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.458994 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:50.470879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.471749 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.472030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.472301 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] PATH_INFO: `/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.473532 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a6d8e17f3f4995b2ef2db59e0772c1)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.475981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.523392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a6d8e17f3f4995b2ef2db59e0772c1', 'request_id': 'req-b0330151-41ab-41f0-855b-156b3a8a190c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.534654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a6d8e17f3f4995b2ef2db59e0772c1', 'request_id': 'req-b0330151-41ab-41f0-855b-156b3a8a190c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.541698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a6d8e17f3f4995b2ef2db59e0772c1', 'request_id': 'req-b0330151-41ab-41f0-855b-156b3a8a190c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.554925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] The token cache is being invalidate because project e4a6d8e17f3f4995b2ef2db59e0772c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:50.555223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.555861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b0330151-41ab-41f0-855b-156b3a8a190c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:50.557424 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1346/2683] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:50 2022] DELETE /identity/v3/projects/e4a6d8e17f3f4995b2ef2db59e0772c1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:50.562363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.562843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.563104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.581796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:50.583574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:50.624115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:50.646136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1338/2684] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:50.654593 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.654889 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.655722 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.675975 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:50.677156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:50.685214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1347/2685] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:50.689481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.699592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32197-30cb-463d-b8f9-9a1cbe5de5de None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.705468 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.706093 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.706578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.706864 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.707595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:50.708432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.710132 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.723083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1339/2686] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:50.728476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.738378 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b593f-244b-4945-ac20-da777fd72b56 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.743362 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.744011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.744287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.744561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.745249 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.747178 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.784252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1348/2687] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:50 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:50.788410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.798511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a8c8-de04-4658-97c4-4863dcf7f04a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.859816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.860484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.860765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.861038 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.861717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.863686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.884744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1340/2688] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:50 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:50.888817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.899685 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f365e-72b4-4f27-ae17-74f8d8323858 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.904493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.905156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.905443 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.905721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.906525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.908117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.918430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1349/2689] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:50.922388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.932819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac319-1182-4539-bc83-8e76845ae3fa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.937350 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.938032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.938315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.938587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.939306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.940894 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c52a-4a3f-4ac7-bb49-e7845c494a2c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:50.952343 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1341/2690] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:50.956365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:50.967369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c70019-bbb1-47e3-959b-bc2c9ba6b822 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:50.972013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:50.972881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:50.973160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:50.973458 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] PATH_INFO: `/v3/projects/d8dad3d32ea1456b85006dbbba6ac901/users/711dd6f660dd4f2092870ff9194baa42/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:50.988032 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dad3d32ea1456b85006dbbba6ac901, user_id=711dd6f660dd4f2092870ff9194baa42, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:50.990797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.004413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1350/2691] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:50 2022] PUT /identity/v3/projects/d8dad3d32ea1456b85006dbbba6ac901/users/711dd6f660dd4f2092870ff9194baa42/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:51.015991 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.016283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.016565 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.042998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] MFA Rules not processed for user `711dd6f660dd4f2092870ff9194baa42`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:51.044181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:51.106184 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1342/2692] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:51.110525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.171405 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eaa91-08c0-46d2-b8da-f22cf863f8ff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.176121 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.177272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.177551 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.177828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.178547 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.180485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.193750 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:51.206870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1351/2693] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:51 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:51.210925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.221720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b547c-e4e9-4a7b-be1c-c6f8800b6bd2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.259633 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:51.278259 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.278983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.279200 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.279471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.280146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.282067 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.302240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1343/2694] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:51 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:51.306179 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.316351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173e6c-da85-4cf7-9412-8f0765ffaf81 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.321965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.322672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.322957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.323252 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.323966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.325603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.336246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1352/2695] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:51.340288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.350422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5485e-d9fc-457c-8fbb-ddb615e0b0ce admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.355082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.355958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.356243 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.356523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] PATH_INFO: `/v3/projects/ee729511653c4bf49f8c666a23397565/users/9be97d1ff47a462c80507befa631ba7b/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.371794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee729511653c4bf49f8c666a23397565, user_id=9be97d1ff47a462c80507befa631ba7b, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.374465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.387483 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1344/2696] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:51 2022] PUT /identity/v3/projects/ee729511653c4bf49f8c666a23397565/users/9be97d1ff47a462c80507befa631ba7b/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:51.391500 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.402071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2fd71-c25b-4a47-99ee-24b407628ddf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.455545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.456200 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.456479 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.456752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.457461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.459597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c8ee9-4b30-4738-8405-602676afba36 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.468910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1353/2697] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:51.473118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.483897 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06927cb0-5bae-4d29-85a4-0070497df8da admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.488584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.489456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.489743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.490060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] PATH_INFO: `/v3/projects/ee729511653c4bf49f8c666a23397565/users/9be97d1ff47a462c80507befa631ba7b/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.492009 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee729511653c4bf49f8c666a23397565, user_id=9be97d1ff47a462c80507befa631ba7b, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.494942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.505450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1345/2698] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:51 2022] PUT /identity/v3/projects/ee729511653c4bf49f8c666a23397565/users/9be97d1ff47a462c80507befa631ba7b/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:51.515329 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.515622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.515899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.542151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] MFA Rules not processed for user `9be97d1ff47a462c80507befa631ba7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:51.543391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:51.610129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1354/2699] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:51.621315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.623039 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:51.679750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60f91-81b9-4913-a1c4-f3fc0bb48ec8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.683395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.684034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.684314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.684590 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.693831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.695305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.704544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1346/2700] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:51.854341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:51.855709 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:51.867643 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a1b2-7271-4fe7-9c0d-ccebad32ccb2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:51.871234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:51.871869 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:51.872149 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:51.872468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:51.930487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:51.932254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c215-2a31-451d-9e71-802d4aaf8041 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:51.941651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1355/2701] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:55.075262 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:55.076676 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.142138 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3500-acff-41d0-a258-02cf93d9b464 service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:55.147115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:55.147979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.148255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.148527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] PATH_INFO: `/v3/users/85d2a96d011342eb8c1244262a1f6667` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.149696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d2a96d011342eb8c1244262a1f6667)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:55.151626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:55.188723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:55.198059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d2a96d011342eb8c1244262a1f6667'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.198870 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d2a96d011342eb8c1244262a1f6667'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.199501 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d2a96d011342eb8c1244262a1f6667'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.211819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d2a96d011342eb8c1244262a1f6667'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.218674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d2a96d011342eb8c1244262a1f6667'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.231708 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1347/2702] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:55 2022] DELETE /identity/v3/users/85d2a96d011342eb8c1244262a1f6667 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:32:55.236194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.236655 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.236752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.242782 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:55.257140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:55.258368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.315918 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1356/2703] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:55.326544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:55.327899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.385136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9117ecc-8bc8-4098-a62e-b468b17f34a4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:55.388810 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:55.389479 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.389765 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.390073 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.399669 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:55.401088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd4155-fe4d-44a0-ba1f-af46e480c56e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:55.410545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1348/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:55.672464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:55.674022 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.688509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dddea-af98-4ee3-b2db-b3eb39b6abc9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:55.694060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:55.694943 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.695226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.695494 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] PATH_INFO: `/v3/projects/a884d8dbb15b401fb19dd6701b1e753a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.696700 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a884d8dbb15b401fb19dd6701b1e753a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:55.698910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:55.748127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a884d8dbb15b401fb19dd6701b1e753a', 'request_id': 'req-e3485699-a52f-4248-b3d3-060eb36ce0ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.753525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a884d8dbb15b401fb19dd6701b1e753a', 'request_id': 'req-e3485699-a52f-4248-b3d3-060eb36ce0ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.760225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a884d8dbb15b401fb19dd6701b1e753a', 'request_id': 'req-e3485699-a52f-4248-b3d3-060eb36ce0ad'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.772155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] The token cache is being invalidate because project a884d8dbb15b401fb19dd6701b1e753a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:55.772442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.773063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e3485699-a52f-4248-b3d3-060eb36ce0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:55.774612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1357/2705] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:55 2022] DELETE /identity/v3/projects/a884d8dbb15b401fb19dd6701b1e753a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:55.779532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.779826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.780105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.797682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:55.798916 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.870066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1349/2706] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:32:55.874081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.874369 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.874651 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.893174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:55.894430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:55.902968 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1358/2707] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:55.907139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:55.917446 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf51cd8-cc87-41fd-b76c-887fc4afa9ac None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:55.922373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:55.923032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.923313 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.923585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.924308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:55.924611 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:55.926242 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:55.939680 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1350/2708] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:55.944335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:55.954334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60d27e-fabe-4ed3-9fb9-5cbc902b09b3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:55.959678 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:55.960344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:55.960627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:55.960903 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:55.961598 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:55.963571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:55.999457 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1359/2709] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:55 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:32:56.003582 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:56.013984 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889a7d1-f9d4-4b84-b8e0-cfde672a5933 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:56.058195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:56.076267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:56.077167 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.077547 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.077781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.078536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:56.080641 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:56.101056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1351/2710] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:56 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:56.105210 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:56.116442 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db2c7-c9c6-4284-af74-0d7626bc0251 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:56.121961 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:56.122720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.123090 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.123397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.124177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:56.125774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:56.137398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1360/2711] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:56.141333 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:56.151766 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9f55e-2157-4945-aeec-f4f03c16a496 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:56.156387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:56.157029 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.157308 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.157581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.158328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:56.159995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96a55-67dd-4050-ab4b-d553c6e933e2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:56.170252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1352/2712] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:56.174439 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:56.184619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee52bea-0892-444d-9f5a-0bb784d3ee3a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:56.189190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:56.190042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.190322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.190590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] PATH_INFO: `/v3/projects/f45456f26abe4e7c82255b0113bde416/users/affd53956500425c81cf9a965e8e7fe8/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.205548 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45456f26abe4e7c82255b0113bde416, user_id=affd53956500425c81cf9a965e8e7fe8, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:56.208254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:56.221404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1361/2713] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:56 2022] PUT /identity/v3/projects/f45456f26abe4e7c82255b0113bde416/users/affd53956500425c81cf9a965e8e7fe8/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:56.226473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.226757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.227030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.244575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:56.245755 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:56.303173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1353/2714] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:56.312468 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:56.314185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:56.341306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:56.374567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b6bc-1725-4956-849b-0a70f9bd37a1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:56.378218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:56.378861 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:56.379143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:56.379419 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:56.389016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:56.390483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3345ed-ee92-41a6-96c2-aac41835e73b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:56.400335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1362/2715] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:57.175989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:57.177645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:57.191435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7633-9ec8-4e28-a8af-f0a94d681f99 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:57.196358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:57.197416 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:57.197801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:57.198208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] PATH_INFO: `/v3/users/711dd6f660dd4f2092870ff9194baa42` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:57.199596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711dd6f660dd4f2092870ff9194baa42)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:57.201661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:57.273120 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711dd6f660dd4f2092870ff9194baa42'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.273882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711dd6f660dd4f2092870ff9194baa42'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.274541 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711dd6f660dd4f2092870ff9194baa42'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.290452 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711dd6f660dd4f2092870ff9194baa42'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.298542 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711dd6f660dd4f2092870ff9194baa42'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.316995 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1354/2716] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:57 2022] DELETE /identity/v3/users/711dd6f660dd4f2092870ff9194baa42 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:57.321440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:57.322016 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:57.322258 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:57.343114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:57.344410 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:57.419127 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1363/2717] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:57.429189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:57.430644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:57.486944 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:57.511825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ad05-a295-4fc4-bd9e-dc8a2c106fd7 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:57.517718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:57.518524 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:57.518904 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:57.519528 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:57.530725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:57.532068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:57.543814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1355/2718] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:32:57.842952 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:57.844629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:57.872344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e78f7f-aacb-4083-a653-8148e6937e23 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:57.887998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:57.888882 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:57.889160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:57.889480 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] PATH_INFO: `/v3/projects/d8dad3d32ea1456b85006dbbba6ac901` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:57.892773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dad3d32ea1456b85006dbbba6ac901)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:57.897460 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:57.957879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dad3d32ea1456b85006dbbba6ac901', 'request_id': 'req-f7ca21a8-952b-476e-aa8e-d2d43ea42853'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.964997 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dad3d32ea1456b85006dbbba6ac901', 'request_id': 'req-f7ca21a8-952b-476e-aa8e-d2d43ea42853'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.973276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dad3d32ea1456b85006dbbba6ac901', 'request_id': 'req-f7ca21a8-952b-476e-aa8e-d2d43ea42853'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.989118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] The token cache is being invalidate because project d8dad3d32ea1456b85006dbbba6ac901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:57.989527 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.991505 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:57.996698 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1364/2719] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:57 2022] DELETE /identity/v3/projects/d8dad3d32ea1456b85006dbbba6ac901 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:57.999090 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:58.018502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd7cbc-745d-440a-a5d8-5026a1b49e7f service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:58.090455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:58.091336 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.091619 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.091896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] PATH_INFO: `/v3/users/9be97d1ff47a462c80507befa631ba7b` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.093087 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be97d1ff47a462c80507befa631ba7b)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:58.095053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:58.147126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be97d1ff47a462c80507befa631ba7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.147727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be97d1ff47a462c80507befa631ba7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.148349 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be97d1ff47a462c80507befa631ba7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.161505 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be97d1ff47a462c80507befa631ba7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.168472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f7a2a026-53c6-453a-8a22-2372b1cfac2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be97d1ff47a462c80507befa631ba7b'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.182659 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1356/2720] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:32:57 2022] DELETE /identity/v3/users/9be97d1ff47a462c80507befa631ba7b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:58.501182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:58.502945 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:58.521525 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca21a8-952b-476e-aa8e-d2d43ea42853 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:58.593321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:58.616297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:58.617647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.618322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.618322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] PATH_INFO: `/v3/projects/ee729511653c4bf49f8c666a23397565` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.619797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee729511653c4bf49f8c666a23397565)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:58.622928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:58.702720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee729511653c4bf49f8c666a23397565', 'request_id': 'req-700b8038-6a0d-43ac-a89e-1ee3c1895658'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.711902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee729511653c4bf49f8c666a23397565', 'request_id': 'req-700b8038-6a0d-43ac-a89e-1ee3c1895658'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.718682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee729511653c4bf49f8c666a23397565', 'request_id': 'req-700b8038-6a0d-43ac-a89e-1ee3c1895658'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.735582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] The token cache is being invalidate because project ee729511653c4bf49f8c666a23397565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:32:58.735582 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.736173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-700b8038-6a0d-43ac-a89e-1ee3c1895658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:32:58.738100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1365/2721] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:32:58 2022] DELETE /identity/v3/projects/ee729511653c4bf49f8c666a23397565 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:58.743543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.743884 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.744168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.766502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:58.767741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:58.824881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:32:58.838291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1357/2722] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:58.846616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.849496 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.849772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.873955 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:58.875305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:58.889453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1366/2723] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:58.890387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:58.905843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1859005-d310-4057-a3e7-cc0f4dd51952 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:58.914642 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:58.915474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.915818 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.916560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.919230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:32:58.919553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:58.921314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:58.939532 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1358/2724] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:32:58.940732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:58.953838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71955bf1-ecad-4f82-b2c5-8c5024ec600e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:58.963446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:58.964081 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:58.964364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:58.964639 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:58.965338 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:58.969061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.008197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1367/2725] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:32:58 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:59.012307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:59.023828 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089e13-ac7c-4dcb-bfbd-f1cd9f7a33ca admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:59.105781 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:59.106149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.106434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.106715 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.107432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:59.109562 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.147784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1359/2726] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:32:59 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:32:59.151586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:59.162590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525438-2efb-46ea-b87d-5c7783dba407 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:59.167156 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:59.167839 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.168125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.168397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.169134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:59.171124 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.186006 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1368/2727] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:32:59.187005 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:59.199472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228ccb5-7044-4261-8996-e3315c488ac5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:59.204807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:59.205563 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.205938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.206292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.207098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:59.209367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb0677-e66c-4df0-bf9d-a02c60131d70 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.230302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1360/2728] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:32:59.232163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:59.244816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128871d0-3359-48dc-b6f8-7aa110e07c2c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:59.250602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:59.251885 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.252340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.252775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] PATH_INFO: `/v3/projects/fdabf3b30f634af288f73f6e893137d7/users/6f4cb9bf7f3b40fc96b8d674cefc93dd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.275185 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdabf3b30f634af288f73f6e893137d7, user_id=6f4cb9bf7f3b40fc96b8d674cefc93dd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:59.280523 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.311929 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1369/2729] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:32:59 2022] PUT /identity/v3/projects/fdabf3b30f634af288f73f6e893137d7/users/6f4cb9bf7f3b40fc96b8d674cefc93dd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:32:59.312986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e6e1-bdc3-418f-a249-cbf8d6dacb90 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.313114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e6e1-bdc3-418f-a249-cbf8d6dacb90 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.313326 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71e6e1-bdc3-418f-a249-cbf8d6dacb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.344331 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-df71e6e1-bdc3-418f-a249-cbf8d6dacb90 None None] MFA Rules not processed for user `6f4cb9bf7f3b40fc96b8d674cefc93dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:32:59.345873 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-df71e6e1-bdc3-418f-a249-cbf8d6dacb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:59.434379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1361/2730] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:32:59.447222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:32:59.449950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:32:59.526641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b3aa6-43b8-4c85-aabf-313e3716c743 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:32:59.531420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:32:59.531818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:32:59.532110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:32:59.532388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:32:59.544245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:32:59.545752 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:32:59.556110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1370/2731] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:00.589869 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:00.590418 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:00.590521 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:00.622490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] MFA Rules not processed for user `affd53956500425c81cf9a965e8e7fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:00.623764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:00.678639 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:00.703958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1362/2732] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:00.708960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:00.710394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:00.731075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:00.780481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46345-2c51-4450-a1e2-fbf27b18ac24 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:00.785045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:00.785795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:00.786173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:00.786544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:00.787318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:00.789326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:00.815739 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1371/2733] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:33:00 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:33:00.820178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:00.831367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498112f-8611-41d3-80fb-39c17a1f60bd None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:00.893192 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:00.893866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:00.894183 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:00.894454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:00.895144 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:00.897105 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:00.920461 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1363/2734] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:33:00 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:33:00.924558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:00.935913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb44107-0677-435e-be38-a0985737c1c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:00.942025 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:00.942842 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:00.943924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:00.943924 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:00.944615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:00.946348 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:00.962973 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1372/2735] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:33:00.967387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:00.986238 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f31e9-5eb6-4267-8f6b-99fbd0a2f2ee admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:00.993154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:00.993750 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:00.994348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:00.994618 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] PATH_INFO: `/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423/users/c26c652f42a44be8bee9b9c317e69b93/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:01.014647 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944c3c7b5c04d17b4c8a5e959ee8423, user_id=c26c652f42a44be8bee9b9c317e69b93, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:01.017388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:01.032436 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1364/2736] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:33:00 2022] PUT /identity/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423/users/c26c652f42a44be8bee9b9c317e69b93/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:33:01.041061 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:01.053629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da11d3e-c31f-471a-8f8f-e0b7a9ff760d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:01.127708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:01.128392 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:01.128681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:01.128956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:01.129694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:01.132947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:01.144830 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1373/2737] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:33:01.149288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:01.160650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74e2c-76de-481e-b988-09ba49e5318f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:01.176775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:01.178288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:01.178571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:01.178842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] PATH_INFO: `/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423/users/c26c652f42a44be8bee9b9c317e69b93/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:01.180866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944c3c7b5c04d17b4c8a5e959ee8423, user_id=c26c652f42a44be8bee9b9c317e69b93, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:01.183523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a98f1-72f1-49b6-82e6-f1dd9d992020 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:01.195236 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1365/2738] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:33:01 2022] PUT /identity/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423/users/c26c652f42a44be8bee9b9c317e69b93/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:02.754237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:02.771959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4b1c9-8075-4ff4-a308-8e923f6ded65 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:02.844198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:02.845083 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:02.845358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:02.845630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] PATH_INFO: `/v3/users/6f4cb9bf7f3b40fc96b8d674cefc93dd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:02.846906 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4cb9bf7f3b40fc96b8d674cefc93dd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:02.848833 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:02.897370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:02.924434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4cb9bf7f3b40fc96b8d674cefc93dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:02.925246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4cb9bf7f3b40fc96b8d674cefc93dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:02.925990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4cb9bf7f3b40fc96b8d674cefc93dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:02.935305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4cb9bf7f3b40fc96b8d674cefc93dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:02.945723 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4cb9bf7f3b40fc96b8d674cefc93dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:02.965802 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1374/2739] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:33:02 2022] DELETE /identity/v3/users/6f4cb9bf7f3b40fc96b8d674cefc93dd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:02.970353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:02.970832 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:02.970932 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:02.990292 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:02.991551 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:03.058992 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1366/2740] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:03.071227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:03.073467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:03.143649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a793f-caef-466d-82f2-bac5a0129318 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:03.148629 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:03.149402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:03.149788 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:03.150206 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:03.161019 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:03.164361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:03.174466 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1375/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:33:03.492581 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:03.494450 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:03.513516 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92da73-4b91-43a2-ab7e-34be4eff8073 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:03.526804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:03.527806 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:03.528301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:03.528671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] PATH_INFO: `/v3/projects/fdabf3b30f634af288f73f6e893137d7` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:03.531653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdabf3b30f634af288f73f6e893137d7)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:03.533630 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:03.595673 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:03.622380 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdabf3b30f634af288f73f6e893137d7', 'request_id': 'req-127f8e1b-5090-44fb-9d95-b7eacf6eec96'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:03.636290 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdabf3b30f634af288f73f6e893137d7', 'request_id': 'req-127f8e1b-5090-44fb-9d95-b7eacf6eec96'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:03.651270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdabf3b30f634af288f73f6e893137d7', 'request_id': 'req-127f8e1b-5090-44fb-9d95-b7eacf6eec96'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:03.702927 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] The token cache is being invalidate because project fdabf3b30f634af288f73f6e893137d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:33:03.703365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:03.705412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-127f8e1b-5090-44fb-9d95-b7eacf6eec96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:03.707518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1367/2742] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:33:03 2022] DELETE /identity/v3/projects/fdabf3b30f634af288f73f6e893137d7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:05.512610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:05.515242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:05.703414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ee376-20a5-4d4e-93dd-41f6ac23c4e3 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:05.827656 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:05.867863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:05.868540 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:05.868823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:05.869096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:05.875572 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:05.933167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:05.935133 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:05.987818 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1376/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:07.012443 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553d9d-29e5-4545-a6bb-33925565f4a4 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:07.013361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553d9d-29e5-4545-a6bb-33925565f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:07.013792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553d9d-29e5-4545-a6bb-33925565f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:07.047703 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4f553d9d-29e5-4545-a6bb-33925565f4a4 None None] MFA Rules not processed for user `c26c652f42a44be8bee9b9c317e69b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:07.049101 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4f553d9d-29e5-4545-a6bb-33925565f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:07.173485 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1368/2744] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:07.186248 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:07.187703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:07.299317 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c4c39-b996-4927-af89-028458b23c28 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:07.317399 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c21819f774b4052bced3ef15f6d83d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:07.318154 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:07.318453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:07.318720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:07.320566 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:07.413886 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:07.415491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:07.426701 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1377/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:07.530885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:07.531180 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:07.531458 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:07.551240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:07.553176 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:07.619340 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1369/2746] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:33:07.641850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:07.643305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:07.724920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ce687-a3cd-47fa-b486-aec9ab1809a4 service glance] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:07.730212 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:07.730870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:07.731155 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:07.731431 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:07.739908 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:07.741516 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:07.749950 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1378/2747] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:33:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:33:11.061303 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:11.062920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:11.096244 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8e526-0dca-4183-8932-ed63ec4c62e7 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:11.104116 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:11.105181 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:11.105626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:11.106098 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:11.109305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:11.250786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:11.309414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:11.314638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:11.350252 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1370/2748] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:11.981666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:11.983804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:12.013327 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:12.073239 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb085-b312-453e-8ef4-0d56564f962e service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:12.077168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:12.078202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:12.078570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:12.079064 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:12.083028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:12.195177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:12.211370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:12.226482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1379/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:15.722136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:15.732170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9e1f-5682-40f3-8b0a-eeb3b7a4ac31 service nova] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:15.744682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:15.746117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:15.746474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:15.746831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:15.748769 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:15.764402 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:15.766699 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08716ab1-6cf7-4f68-8bf0-4e01887cb61a service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:15.780133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1371/2750] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:16.951166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:16.952998 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:17.057718 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea8d86-09bc-48b8-9b46-cd332d3ecde2 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:17.063462 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:17.064145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:17.064452 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:17.064697 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:17.066519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:17.081967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:17.084792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:17.099101 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1380/2751] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 15:33:19.779945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:19.780928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:19.781215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:19.805607 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] MFA Rules not processed for user `affd53956500425c81cf9a965e8e7fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:19.807213 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:19.815119 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1372/2752] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:20.282011 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:20.285181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:20.302130 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aec60-f7a3-48f9-af70-298e41961de4 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:20.312617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:20.313570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:20.314318 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:20.314813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:20.318316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:20.336051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:20.338657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:20.356076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1381/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:21.576270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:21.579814 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:21.596210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1646-71a2-4a23-a000-14cc0cc3b119 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:21.601792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:21.602761 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:21.603044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:21.603316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] PATH_INFO: `/v3/users/855568cbf9da4d3680a1f212fa9e4222` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:21.604776 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855568cbf9da4d3680a1f212fa9e4222)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:21.606912 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:21.677704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855568cbf9da4d3680a1f212fa9e4222'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:21.679381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855568cbf9da4d3680a1f212fa9e4222'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:21.680376 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855568cbf9da4d3680a1f212fa9e4222'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:21.696365 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855568cbf9da4d3680a1f212fa9e4222'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:21.703996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855568cbf9da4d3680a1f212fa9e4222'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:21.726723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1373/2754] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:33:21 2022] DELETE /identity/v3/users/855568cbf9da4d3680a1f212fa9e4222 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:22.150033 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.163666 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057bbc7-ac8b-4361-ba56-b5bbd22c8e5f service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.208491 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.210960 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.228681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=100 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:22.246096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.247321 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.247694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.248039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] PATH_INFO: `/v3/projects/a16acec6b0754440826cca1108e4d377` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.249949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16acec6b0754440826cca1108e4d377)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.252472 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.303102 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c1b7a-a7c2-43a3-9c2d-56acb53178f4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.311428 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.312445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.312844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.313122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] PATH_INFO: `/v3/users/c61d758271a44ee5acd682f175217506` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.314725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61d758271a44ee5acd682f175217506)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.317054 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.322113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16acec6b0754440826cca1108e4d377', 'request_id': 'req-467a5527-cc11-4a5b-b036-de446ade1135'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.327964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16acec6b0754440826cca1108e4d377', 'request_id': 'req-467a5527-cc11-4a5b-b036-de446ade1135'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.334535 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16acec6b0754440826cca1108e4d377', 'request_id': 'req-467a5527-cc11-4a5b-b036-de446ade1135'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.352265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] The token cache is being invalidate because project a16acec6b0754440826cca1108e4d377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:33:22.352559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.353526 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-467a5527-cc11-4a5b-b036-de446ade1135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.355181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1382/2755] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:33:22 2022] DELETE /identity/v3/projects/a16acec6b0754440826cca1108e4d377 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:22.360303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.360790 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.361233 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.367223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:22.374499 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61d758271a44ee5acd682f175217506'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.375816 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61d758271a44ee5acd682f175217506'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.376637 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61d758271a44ee5acd682f175217506'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.384098 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:22.385558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.391269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61d758271a44ee5acd682f175217506'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.401076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-f2e9c2d5-0686-45ac-8faa-39cfaa0782ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61d758271a44ee5acd682f175217506'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.416930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1374/2756] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:33:22 2022] DELETE /identity/v3/users/c61d758271a44ee5acd682f175217506 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:22.449893 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1383/2757] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:22.458099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.458395 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.458672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.478741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:22.479953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.541223 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1375/2758] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:22.545265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.555784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b6c7-abbe-408f-9f12-b4ba012c069e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.561287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.561978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.562263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.562542 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.563272 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:33:22.563578 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.565168 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.580322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1384/2759] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:33:22.584463 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.594683 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5188ae-5da7-4215-aa0f-fc45473a6be1 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.597067 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.599613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.601379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.602096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.602386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.602670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.603445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.605351 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.612971 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56f29-992c-42e4-b360-c202b3a0396b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.619219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.620082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.620377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.620630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] PATH_INFO: `/v3/projects/6bcea71b75474df4bf08c33b6f7d813a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.621821 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcea71b75474df4bf08c33b6f7d813a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.623774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.639474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1376/2760] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:33:22 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:33:22.643718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.677202 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcea71b75474df4bf08c33b6f7d813a', 'request_id': 'req-4834e3df-8e96-4a46-a713-9bc54cb29b6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.687118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:22.690445 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcea71b75474df4bf08c33b6f7d813a', 'request_id': 'req-4834e3df-8e96-4a46-a713-9bc54cb29b6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.701766 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcea71b75474df4bf08c33b6f7d813a', 'request_id': 'req-4834e3df-8e96-4a46-a713-9bc54cb29b6e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.717840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] The token cache is being invalidate because project 6bcea71b75474df4bf08c33b6f7d813a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:33:22.718218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.718812 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.722710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1385/2761] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:33:22 2022] DELETE /identity/v3/projects/6bcea71b75474df4bf08c33b6f7d813a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:33:22.724210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f348-8df4-4a65-a9e4-b9a406b2ba38 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.727432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.729144 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.776899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:22.807760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.808636 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.809026 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.810209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.811199 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.813583 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.815111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834e3df-8e96-4a46-a713-9bc54cb29b6e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.821017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.822190 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.822514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.822850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] PATH_INFO: `/v3/users/bc6a4e199fa640f08a32be232914748b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.824736 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6a4e199fa640f08a32be232914748b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.827048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.839079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1377/2762] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:33:22 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:33:22.842775 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.845022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.860490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8a259-98e5-45ff-99b0-247f5d771669 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.866047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.867813 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.868187 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.868444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.869342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.871719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.908013 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1378/2763] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:33:22.909066 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.915753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6a4e199fa640f08a32be232914748b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.917620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6a4e199fa640f08a32be232914748b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.918265 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6a4e199fa640f08a32be232914748b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.928310 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98e9b-917a-45b4-8ae1-5ae7d85f0da6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.928538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6a4e199fa640f08a32be232914748b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.933306 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.934110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.934589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.934938 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.935675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:22.937283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:22.942772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-108f2ee2-e1f1-4e4f-985d-b949c1da3cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6a4e199fa640f08a32be232914748b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:22.950354 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1379/2764] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 15:33:22.954226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:22.956189 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:22.972337 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597edf-9bfa-42da-b44d-330e702bd3d2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:22.978435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:22.979575 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:22.979859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:22.980377 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] PATH_INFO: `/v3/projects/9f7ad8a08d1744f3b7422fbeb2a3e61f/users/917f3e688667402ea1ef34657e94edc5/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:22.981307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1386/2765] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:33:22 2022] DELETE /identity/v3/users/bc6a4e199fa640f08a32be232914748b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:33:22.999800 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7ad8a08d1744f3b7422fbeb2a3e61f, user_id=917f3e688667402ea1ef34657e94edc5, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:23.002663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32a21a-d7e7-4278-853b-033abd587501 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:23.026822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1380/2766] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:33:22 2022] PUT /identity/v3/projects/9f7ad8a08d1744f3b7422fbeb2a3e61f/users/917f3e688667402ea1ef34657e94edc5/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:33:23.028663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:23.029053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:23.029363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:23.051865 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:23.053113 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:23.077844 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:23.078357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:23.078822 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:23.098480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:23.099936 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:23.134214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1387/2767] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:33:23.146844 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:23.148440 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:23.157131 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:23.189953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1381/2768] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:33:23.194606 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:23.197240 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:23.226246 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f574-ce91-415e-b933-6c7d07096bd6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:23.233857 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:23.234820 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:23.236163 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:23.236568 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:23.253934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:23.256132 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:23.267039 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1388/2769] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:23.327289 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:23.328891 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:23.336476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58965-14ff-46bb-9304-49e6294b5e10 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:23.342285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:23.342867 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:23.343164 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:23.343449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:23.362361 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fb534-19a4-4db1-9e16-39d547e9a514 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:23.369476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:23.375902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:23.377965 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:23.378232 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:23.378515 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] PATH_INFO: `/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:23.381135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570cd1-7adc-4d1a-922d-c0f92e9608fd service swift] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:23.381339 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28b36dbcbc44bf2a63c483eab7f4757)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:23.383502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:23.393544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1382/2770] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:33:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 15:33:23.492195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28b36dbcbc44bf2a63c483eab7f4757', 'request_id': 'req-b60197ae-1184-429f-a52c-4ec1a359f0f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:23.511597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28b36dbcbc44bf2a63c483eab7f4757', 'request_id': 'req-b60197ae-1184-429f-a52c-4ec1a359f0f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:23.526610 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28b36dbcbc44bf2a63c483eab7f4757', 'request_id': 'req-b60197ae-1184-429f-a52c-4ec1a359f0f5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:23.556606 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] The token cache is being invalidate because project a28b36dbcbc44bf2a63c483eab7f4757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:33:23.556894 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:23.558434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:33:23.560167 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1389/2771] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:33:23 2022] DELETE /identity/v3/projects/a28b36dbcbc44bf2a63c483eab7f4757 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:33:29.154148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c58e8-8177-4c29-b329-1eb59e77082f None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:29.154736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c58e8-8177-4c29-b329-1eb59e77082f None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:29.154736 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c58e8-8177-4c29-b329-1eb59e77082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:29.226716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-351c58e8-8177-4c29-b329-1eb59e77082f None None] MFA Rules not processed for user `917f3e688667402ea1ef34657e94edc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:29.228819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-351c58e8-8177-4c29-b329-1eb59e77082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:29.251016 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:29.363429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1383/2772] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:29.378809 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:29.380391 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:29.540323 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60197ae-1184-429f-a52c-4ec1a359f0f5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:29.550658 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:29.551649 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:29.553654 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:29.554430 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:29.570995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:29.572912 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:29.587256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1390/2773] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:31.321974 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:31.322545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:31.322545 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:31.340486 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] MFA Rules not processed for user `917f3e688667402ea1ef34657e94edc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:33:31.341689 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:31.349398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1384/2774] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:33:31.692243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:31.693925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:31.713332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:31.760720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917f3a2-6d96-4ba1-b4ca-0a61c791638e service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:31.764370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:31.765051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:31.765368 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:31.765677 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:31.767665 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:31.781784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:31.783682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:31.794255 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1391/2775] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:41.335145 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=25 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:41.790708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=19 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:33:44.510829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:33:44.512427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:44.524211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b21db3-f63d-40b8-950d-5fa6ca1c9367 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:33:44.527707 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:33:44.528348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:33:44.528626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:33:44.528893 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:33:44.530577 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:33:44.598141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:33:44.599592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16e75-40e3-4de0-a89e-9d11bb5009ab service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:33:44.609702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1385/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:33:54.605757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=30 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:34:45.532164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:34:45.533644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:34:45.602904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067afd-8645-412e-8340-f5b2dc5e94e9 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:34:45.607964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:34:45.608609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:34:45.608892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:34:45.609166 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:34:45.611037 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:34:45.623181 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:34:45.624745 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:34:45.634660 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1392/2777] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:34:55.630297 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=32 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:06.688650 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:06.689150 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:06.689251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:06.707347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] MFA Rules not processed for user `71223c29d15c41f8b5e0ec738b7b327c`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:35:06.708527 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:35:06.763225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1386/2778] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:35:06.802331 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:35:06.803817 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:35:06.872146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65529f60-6a69-48b5-8c41-de378d911449 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:35:06.877085 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530cf69a596d42eeb576903bb39816cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:35:06.878324 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:06.878608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:06.878879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:06.886856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:35:06.888427 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:35:06.897028 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1393/2779] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 15:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 15:35:13.359504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:35:13.361096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:35:13.439735 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7101f6-8c92-474b-8182-8a813f5af633 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:35:13.444114 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:35:13.445011 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:13.445288 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:13.445586 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] PATH_INFO: `/v3/users/affd53956500425c81cf9a965e8e7fe8` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:13.446808 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affd53956500425c81cf9a965e8e7fe8)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:35:13.448720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:35:13.499805 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affd53956500425c81cf9a965e8e7fe8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.500472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affd53956500425c81cf9a965e8e7fe8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.501083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affd53956500425c81cf9a965e8e7fe8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.513178 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affd53956500425c81cf9a965e8e7fe8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.520967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affd53956500425c81cf9a965e8e7fe8'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.535571 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1387/2780] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:35:13 2022] DELETE /identity/v3/users/affd53956500425c81cf9a965e8e7fe8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:35:13.725421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:35:13.737398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa68eb-6fc3-4354-99c1-b3ce8585ae67 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:35:13.796922 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:35:13.797705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:13.798024 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:13.798302 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] PATH_INFO: `/v3/projects/f45456f26abe4e7c82255b0113bde416` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:13.799486 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45456f26abe4e7c82255b0113bde416)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:35:13.801400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:35:13.846334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45456f26abe4e7c82255b0113bde416', 'request_id': 'req-bca66776-c420-4a72-add8-051d6105d4cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.851715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45456f26abe4e7c82255b0113bde416', 'request_id': 'req-bca66776-c420-4a72-add8-051d6105d4cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.857846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45456f26abe4e7c82255b0113bde416', 'request_id': 'req-bca66776-c420-4a72-add8-051d6105d4cb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.870153 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] The token cache is being invalidate because project f45456f26abe4e7c82255b0113bde416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:35:13.870441 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.871054 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:13.872999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1394/2781] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:35:13 2022] DELETE /identity/v3/projects/f45456f26abe4e7c82255b0113bde416 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:35:13.877661 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:35:13.880654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:35:13.892126 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f2df4-b756-4855-968b-18d511e459e4 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:35:13.912422 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:13.950173 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:35:13.951046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:13.951327 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:13.951599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] PATH_INFO: `/v3/users/c26c652f42a44be8bee9b9c317e69b93` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:13.952771 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26c652f42a44be8bee9b9c317e69b93)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:35:13.954724 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:35:14.001383 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26c652f42a44be8bee9b9c317e69b93'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.002070 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26c652f42a44be8bee9b9c317e69b93'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.003265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26c652f42a44be8bee9b9c317e69b93'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.014983 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26c652f42a44be8bee9b9c317e69b93'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.022332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-5e46e4be-b243-4f52-bd89-9e20b054e63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26c652f42a44be8bee9b9c317e69b93'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.036001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1388/2782] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:35:13 2022] DELETE /identity/v3/users/c26c652f42a44be8bee9b9c317e69b93 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:35:14.204792 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:35:14.207007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:35:14.220597 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66776-c420-4a72-add8-051d6105d4cb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:35:14.238477 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:14.280902 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:35:14.281799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:35:14.282245 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:35:14.282531 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] PATH_INFO: `/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:35:14.283784 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c944c3c7b5c04d17b4c8a5e959ee8423)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:35:14.285816 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:35:14.332381 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c944c3c7b5c04d17b4c8a5e959ee8423', 'request_id': 'req-bdf1fc46-6a05-4f75-a8de-0ae835866b42'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.337987 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c944c3c7b5c04d17b4c8a5e959ee8423', 'request_id': 'req-bdf1fc46-6a05-4f75-a8de-0ae835866b42'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.344036 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c944c3c7b5c04d17b4c8a5e959ee8423', 'request_id': 'req-bdf1fc46-6a05-4f75-a8de-0ae835866b42'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.356554 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] The token cache is being invalidate because project c944c3c7b5c04d17b4c8a5e959ee8423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:35:14.356849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.357476 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:35:14.359030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1395/2783] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:35:14 2022] DELETE /identity/v3/projects/c944c3c7b5c04d17b4c8a5e959ee8423 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:35:24.031954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:35:24.353537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:36:03.257250 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:36:03.257784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:36:03.257784 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:36:03.276910 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] MFA Rules not processed for user `917f3e688667402ea1ef34657e94edc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:36:03.278136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:36:03.333644 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1389/2784] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:36:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:36:13.326378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=25 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:36:46.401742 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:36:46.403214 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:36:46.459409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fc46-6a05-4f75-a8de-0ae835866b42 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:36:46.463160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:36:46.463798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:36:46.464076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:36:46.464345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:36:46.466119 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:36:46.537291 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:36:46.538758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:36:46.550358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1396/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:36:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:36:49.353757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:36:49.363979 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cdeb0-357f-4585-8d46-a761fd18d87a None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:36:49.367447 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:36:49.368078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:36:49.368358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:36:49.368629 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:36:49.370370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:36:49.383881 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:36:49.385300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:36:49.396324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1390/2786] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:36:56.544960 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=54 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:36:59.391302 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:05.676798 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:05.678396 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:05.731076 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:05.733502 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:05.756035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e06d0-dad5-4b9c-9948-307cb2a9f1b8 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:05.761073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:05.761735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:05.762051 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:05.762322 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:05.764097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:05.776947 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:05.778647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:05.789519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1397/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:05.805760 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db59b-adbd-4972-afc5-ff047df8adfe service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:05.810248 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:05.811291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:05.811574 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:05.811847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] PATH_INFO: `/v3/users/917f3e688667402ea1ef34657e94edc5` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:05.813091 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917f3e688667402ea1ef34657e94edc5)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:05.815139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:05.863553 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917f3e688667402ea1ef34657e94edc5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:05.864197 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917f3e688667402ea1ef34657e94edc5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:05.864799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917f3e688667402ea1ef34657e94edc5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:05.876626 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917f3e688667402ea1ef34657e94edc5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:05.883417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-41b88d14-2d61-4446-99cf-caad44143f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917f3e688667402ea1ef34657e94edc5'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:05.896227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1391/2788] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:05 2022] DELETE /identity/v3/users/917f3e688667402ea1ef34657e94edc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:06.071017 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.081829 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a770-fe43-487d-a026-8cf235e70e42 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.137520 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.138407 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.138692 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.138964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] PATH_INFO: `/v3/projects/9f7ad8a08d1744f3b7422fbeb2a3e61f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.140128 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7ad8a08d1744f3b7422fbeb2a3e61f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.142105 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.186428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7ad8a08d1744f3b7422fbeb2a3e61f', 'request_id': 'req-91f14147-0afb-4410-87fc-e54a3fb69e10'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:06.191963 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7ad8a08d1744f3b7422fbeb2a3e61f', 'request_id': 'req-91f14147-0afb-4410-87fc-e54a3fb69e10'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:06.198047 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7ad8a08d1744f3b7422fbeb2a3e61f', 'request_id': 'req-91f14147-0afb-4410-87fc-e54a3fb69e10'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:06.209562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] The token cache is being invalidate because project 9f7ad8a08d1744f3b7422fbeb2a3e61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:06.209845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:06.210483 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-91f14147-0afb-4410-87fc-e54a3fb69e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:06.212097 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1398/2789] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:06 2022] DELETE /identity/v3/projects/9f7ad8a08d1744f3b7422fbeb2a3e61f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:06.217149 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.217511 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.217796 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.237163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:06.238482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:06.297031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1392/2790] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:06.305050 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.305340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.305621 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.323721 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:06.324917 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:06.332864 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1399/2791] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:06.337515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.347799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ec500-f1b6-490d-b8d7-11e7b3b64379 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.352514 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.353196 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.353477 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.353748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.354508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:06.354812 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.356425 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.368783 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1393/2792] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:37:06.372897 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.382243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea7957-efa4-49b5-97a9-e96d16f521e0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.386850 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.387491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.387772 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.388045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.388728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.390642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.402617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:06.419883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1400/2793] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:06 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:06.424034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.433839 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1608-3744-4cd4-8641-1435e8b7aa41 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.437341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:06.493786 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.494557 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.494841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.495115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.495807 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.497718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.517702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1394/2794] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:06 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:06.521811 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.531978 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668ebfd-2d97-48c1-a091-fdc8d15a0d99 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.537106 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.537753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.538071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.538347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.539060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.540636 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.550350 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1401/2795] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:06.554025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.563940 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed45f6-8ae3-416d-b61f-006721c3af6c admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.568517 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.569161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.569444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.569719 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.570473 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.572050 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922bdb-b497-4ea5-9545-21ba1f1f8699 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.582342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1395/2796] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:06.586218 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.597092 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5901-3f5a-4eca-bfb3-9617180608f8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.601780 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.602711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.602993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.603264 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] PATH_INFO: `/v3/projects/30bb604453794495bbbbd22b1aa75901/users/9592ccf7545e4db89409faaf4c02919f/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.617849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bb604453794495bbbbd22b1aa75901, user_id=9592ccf7545e4db89409faaf4c02919f, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.620503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.633180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1402/2797] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:06 2022] PUT /identity/v3/projects/30bb604453794495bbbbd22b1aa75901/users/9592ccf7545e4db89409faaf4c02919f/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:06.643589 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.643875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.644153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.670278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] MFA Rules not processed for user `9592ccf7545e4db89409faaf4c02919f`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:06.671474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:06.734429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1396/2798] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:06.745925 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:06.747624 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:06.825981 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59642-f55a-4cf7-aaf5-44435bee5b55 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:06.832223 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92191aff46eb4e98b5923c3ad95a8012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:06.832890 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:06.833174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:06.833453 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:06.842288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:06.843910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1adcb9-5bc7-4670-9490-9fd74d9ac99a service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:06.854225 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1403/2799] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:12.003282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.062421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de782cfa-5cde-4c26-b52f-d1820c30c45e None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.067552 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.068415 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.068690 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.068959 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] PATH_INFO: `/v3/users/9592ccf7545e4db89409faaf4c02919f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.070141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9592ccf7545e4db89409faaf4c02919f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.072040 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:12.087804 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:12.116688 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9592ccf7545e4db89409faaf4c02919f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.117353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9592ccf7545e4db89409faaf4c02919f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.117986 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9592ccf7545e4db89409faaf4c02919f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.130225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9592ccf7545e4db89409faaf4c02919f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.137063 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9592ccf7545e4db89409faaf4c02919f'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.149603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1397/2800] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:11 2022] DELETE /identity/v3/users/9592ccf7545e4db89409faaf4c02919f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:37:12.154377 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.154878 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.154976 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.172100 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:12.173278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:12.231489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1404/2801] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:12.241300 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.242747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:12.299208 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95052d5d-182b-49e5-bfda-fee56632cf77 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.302898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.303543 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.303827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.304099 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.313163 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.315161 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e726e-7a22-496e-ae08-fcd37adf79a8 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:12.324465 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1398/2802] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:12.583438 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.585049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:12.597503 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec33db-5643-47dd-89e2-67f76ee61383 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.603314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.604182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.604461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.604728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] PATH_INFO: `/v3/projects/30bb604453794495bbbbd22b1aa75901` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.605932 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bb604453794495bbbbd22b1aa75901)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.608675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:12.650072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:12.660351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bb604453794495bbbbd22b1aa75901', 'request_id': 'req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.665979 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bb604453794495bbbbd22b1aa75901', 'request_id': 'req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.672125 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bb604453794495bbbbd22b1aa75901', 'request_id': 'req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.684237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] The token cache is being invalidate because project 30bb604453794495bbbbd22b1aa75901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:12.684522 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.685242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bebb07ce-a4b1-40cb-89f6-c6dc93169d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:12.686813 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1405/2803] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:12 2022] DELETE /identity/v3/projects/30bb604453794495bbbbd22b1aa75901 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:12.692291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.692605 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.692907 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.712509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:12.713725 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:12.777453 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1399/2804] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:12.787046 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.787433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.787787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.809082 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:12.810616 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:12.818999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1406/2805] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:12.823603 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.833714 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3a82-5f7b-4b8f-945c-b6fc8b566402 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.838429 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.839112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.839398 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.839674 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.840397 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:12.840704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.842342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:12.855580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1400/2806] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:37:12.859596 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.870207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349c0ea-2249-4950-a76e-585b3463437a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.874967 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.875619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.875974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.876256 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.876949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.878896 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:12.904984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1407/2807] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:12 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:12.909386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:12.920111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e27f4f-d2ff-4f18-bdf0-bedb546bd363 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:12.943860 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:12.982079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:12.982883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:12.983235 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:12.983584 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:12.984347 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:12.987153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.005858 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1401/2808] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:12 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:13.009990 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.020194 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6779-20ba-4448-84e1-00b2b5c4945b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.024895 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.025545 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.025823 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.026719 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.027446 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.029030 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.039672 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1408/2809] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:13.043489 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.053957 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2942de-0966-4635-825e-8331e356e810 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.058449 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.059089 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.059367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.059638 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.060352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.061934 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a82b8-b7cd-4f85-aa27-675085803295 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.071815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1402/2810] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:13.075559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.085406 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e973-3c4c-4250-9b9c-0b4cc6d25061 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.089928 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.090796 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.091075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.091345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] PATH_INFO: `/v3/projects/7e8bf77bc446403781d5fbae548e4622/users/e57d6ae901fd4e02b09f8dc67aa13744/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.105851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8bf77bc446403781d5fbae548e4622, user_id=e57d6ae901fd4e02b09f8dc67aa13744, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.108485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.121401 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1409/2811] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:13 2022] PUT /identity/v3/projects/7e8bf77bc446403781d5fbae548e4622/users/e57d6ae901fd4e02b09f8dc67aa13744/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:13.131404 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.131723 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.132000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.159369 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] MFA Rules not processed for user `e57d6ae901fd4e02b09f8dc67aa13744`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:13.160558 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:13.222889 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1403/2812] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:13.227371 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.287828 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b0ad2-4021-4bc1-a56a-02d97939d24d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.292485 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.293134 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.293413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.293681 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.294403 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.296306 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.321014 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1410/2813] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:13 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:13.325047 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.336115 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a028e1-c3f6-4a3b-bbc1-2a60920c2475 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.390978 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.392285 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.392569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.392843 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.393536 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.395476 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.415356 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1404/2814] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:13 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:13.419411 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.429667 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407ecf-7d30-4730-a679-2132b8cb45e6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.434217 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.434863 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.435143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.435415 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.436135 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.437708 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.447940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1411/2815] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:13.451923 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.462367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3b535-e878-4036-a0ad-d9e360f42da5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.466885 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.467748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.468031 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.468307 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] PATH_INFO: `/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a/users/58160aa2467941debabf7957f5331f96/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.483378 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ef764c5f854f59b7dc48f43c51e19a, user_id=58160aa2467941debabf7957f5331f96, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.486081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.495158 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:13.502061 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1405/2816] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:13 2022] PUT /identity/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a/users/58160aa2467941debabf7957f5331f96/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:13.505969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.515870 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688b43-f327-41d0-8843-2dd67853a551 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.547495 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:13.572845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.573502 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.573786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.574087 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.574803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.576388 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7501-ef51-4a2e-ad19-fcd0aa4ce24b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.586421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1412/2817] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:13.590523 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.601169 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321272-9b2d-4905-bebb-087f0586fc21 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.605817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.606722 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.607004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.607278 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] PATH_INFO: `/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a/users/58160aa2467941debabf7957f5331f96/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.609266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ef764c5f854f59b7dc48f43c51e19a, user_id=58160aa2467941debabf7957f5331f96, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.612159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.622225 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1406/2818] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:13 2022] PUT /identity/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a/users/58160aa2467941debabf7957f5331f96/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:13.632620 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.632941 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.633222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.666276 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] MFA Rules not processed for user `58160aa2467941debabf7957f5331f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:13.667493 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:13.734860 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1413/2819] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:13.745526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:13.747357 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:13.805153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9ed-552f-4771-b6f4-0573b87446bb admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:13.808826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:13.809472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:13.809764 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:13.810079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:13.819929 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:13.821379 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41cad8-eef0-4cf3-be1c-fbea440423d2 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:13.831421 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1407/2820] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:13.957562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:14.018567 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02dee5-0000-4695-af0e-6c8a95841bff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:14.022934 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:14.023795 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:14.024073 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:14.024345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] PATH_INFO: `/v3/users/e57d6ae901fd4e02b09f8dc67aa13744` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:14.025537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57d6ae901fd4e02b09f8dc67aa13744)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:14.027478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:14.072120 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57d6ae901fd4e02b09f8dc67aa13744'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.072751 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57d6ae901fd4e02b09f8dc67aa13744'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.073358 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57d6ae901fd4e02b09f8dc67aa13744'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.080084 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57d6ae901fd4e02b09f8dc67aa13744'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.082544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:14.088065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57d6ae901fd4e02b09f8dc67aa13744'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.106822 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1414/2821] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:13 2022] DELETE /identity/v3/users/e57d6ae901fd4e02b09f8dc67aa13744 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:14.112086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:14.112548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:14.112645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:14.130226 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:14.131423 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:14.189408 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1408/2822] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:14.199198 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:14.200615 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:14.258425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167e392-3740-44da-a6d9-6ca6ca1c8648 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:14.262136 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:14.262774 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:14.263055 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:14.263326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:14.272365 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:14.273732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:14.283799 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1415/2823] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:14.547229 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:14.548734 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:14.562861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6393d5-c6a0-43fc-b51c-cd158f68b9db None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:14.568390 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:14.569282 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:14.569741 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:14.569925 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] PATH_INFO: `/v3/projects/7e8bf77bc446403781d5fbae548e4622` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:14.571227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8bf77bc446403781d5fbae548e4622)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:14.573193 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:14.620118 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8bf77bc446403781d5fbae548e4622', 'request_id': 'req-1989e08b-38e0-4849-9dda-05d054919cfa'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.625454 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8bf77bc446403781d5fbae548e4622', 'request_id': 'req-1989e08b-38e0-4849-9dda-05d054919cfa'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.632846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8bf77bc446403781d5fbae548e4622', 'request_id': 'req-1989e08b-38e0-4849-9dda-05d054919cfa'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.644078 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] The token cache is being invalidate because project 7e8bf77bc446403781d5fbae548e4622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:14.644358 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.644968 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.646506 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1409/2824] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:14 2022] DELETE /identity/v3/projects/7e8bf77bc446403781d5fbae548e4622 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:14.650435 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:14.660160 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934ae6-05c8-4993-a4fa-9419f542b635 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:14.714414 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:14.715278 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:14.715562 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:14.715837 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] PATH_INFO: `/v3/users/58160aa2467941debabf7957f5331f96` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:14.717000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=58160aa2467941debabf7957f5331f96)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:14.719048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:14.763688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58160aa2467941debabf7957f5331f96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.764314 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58160aa2467941debabf7957f5331f96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.764905 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58160aa2467941debabf7957f5331f96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.771653 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58160aa2467941debabf7957f5331f96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.778042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9e3cc0e3-1b5a-4284-a643-4ecbbb5ee9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58160aa2467941debabf7957f5331f96'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:14.791204 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:14.796838 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1416/2825] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:14 2022] DELETE /identity/v3/users/58160aa2467941debabf7957f5331f96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:15.062695 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.064751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:15.079671 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e08b-38e0-4849-9dda-05d054919cfa admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.088670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:15.138964 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.139830 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.140112 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.140386 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] PATH_INFO: `/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.142216 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ef764c5f854f59b7dc48f43c51e19a)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.144122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.189012 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ef764c5f854f59b7dc48f43c51e19a', 'request_id': 'req-818b89a5-4114-45c9-884c-accc7751791a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:15.194472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ef764c5f854f59b7dc48f43c51e19a', 'request_id': 'req-818b89a5-4114-45c9-884c-accc7751791a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:15.201591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ef764c5f854f59b7dc48f43c51e19a', 'request_id': 'req-818b89a5-4114-45c9-884c-accc7751791a'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:15.213044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] The token cache is being invalidate because project c8ef764c5f854f59b7dc48f43c51e19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:15.213329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:15.213977 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-818b89a5-4114-45c9-884c-accc7751791a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:15.215487 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1410/2826] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:15 2022] DELETE /identity/v3/projects/c8ef764c5f854f59b7dc48f43c51e19a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:15.220341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.220634 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.220916 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.238800 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:15.239989 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:15.298964 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1417/2827] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:15.307990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.308253 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.308533 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.327291 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:15.328472 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:15.336875 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1411/2828] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:15.340962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.350467 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2cff-2325-4c54-97c6-43b8d58b6e7d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.354969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.355609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.355887 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.356157 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.356875 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:15.357176 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.358888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.370461 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1418/2829] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:37:15.374370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.384034 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499b7d8-9ce0-432e-9674-2e0839fd4026 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.388744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.389434 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.389753 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.390068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.390758 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.393329 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.418264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1412/2830] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:15.422187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.432482 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6456b-0fdc-40ef-ac5a-a6edad206bfd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.488215 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.489038 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.489316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.489603 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.490307 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.492195 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.511390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1419/2831] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:15.515346 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.526475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99633e5-e3aa-4af4-9879-eca09e2008c2 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.531079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.532459 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.532745 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.533022 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.533751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.535387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.545700 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1413/2832] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:15.550052 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.559914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c41f9-b32e-4f56-ac65-ee4404f7ab92 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.565089 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.565733 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.566071 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.566345 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.567063 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.568641 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e31163-6d60-4fbe-a53a-417ec569703c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.578402 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1420/2833] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:15.582794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.592727 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d13cd-a559-4b26-bdaa-86b1c1869c82 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.598032 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.599271 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.599554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.599829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] PATH_INFO: `/v3/projects/5cdcb419b57f4b72aa5be26aeb22cfed/users/0621b159df9b4e3fa8b4ddd46e1bfabd/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.614684 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdcb419b57f4b72aa5be26aeb22cfed, user_id=0621b159df9b4e3fa8b4ddd46e1bfabd, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.617301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.630522 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1414/2834] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:15 2022] PUT /identity/v3/projects/5cdcb419b57f4b72aa5be26aeb22cfed/users/0621b159df9b4e3fa8b4ddd46e1bfabd/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:37:15.640586 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.640868 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.641143 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.672575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] MFA Rules not processed for user `0621b159df9b4e3fa8b4ddd46e1bfabd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:15.673776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:15.727173 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:15.738630 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1421/2835] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:15.743122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.784007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:15.806230 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac2d6-efdf-4650-974d-4aade88953a5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.810990 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.811592 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.811876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.812152 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.812848 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.816265 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.841088 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1415/2836] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:15.845045 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.855608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bdb29-26fd-4a5a-99c9-dda41784fca3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.911111 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.911808 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.912095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.912370 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.913060 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.915049 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.934400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1422/2837] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:15 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:15.939139 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.949561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c320-3e9a-4448-8e1c-4893f7c405e0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.954788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.955444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.955726 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.955998 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:15.956717 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:15.958348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:15.968628 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1416/2838] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:15.972571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:15.982518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258eec8-d250-4d04-a65c-e6e29437617a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:15.987519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:15.988404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:15.988753 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:15.988957 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] PATH_INFO: `/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0/users/a45ad433effb4583b4c8bf8cbc8d6eb9/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.004481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e485b5feaa54fa0bc07f2e12222d9b0, user_id=a45ad433effb4583b4c8bf8cbc8d6eb9, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:16.007263 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:16.020171 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1423/2839] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:15 2022] PUT /identity/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0/users/a45ad433effb4583b4c8bf8cbc8d6eb9/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:16.024000 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:16.033788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ba80-0f92-44f7-afda-73dd21c9048b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:16.089018 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:16.089645 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.090004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.090353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.091131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:16.092697 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c0eb9-1d22-4c6b-8e8e-9fce1825bedf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:16.102246 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1417/2840] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:16.106349 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:16.117209 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82779814-6789-4f37-bd57-60bb562ee358 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:16.121845 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:16.122757 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.123041 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.123320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] PATH_INFO: `/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0/users/a45ad433effb4583b4c8bf8cbc8d6eb9/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.125303 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e485b5feaa54fa0bc07f2e12222d9b0, user_id=a45ad433effb4583b4c8bf8cbc8d6eb9, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:16.128537 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:16.138728 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1424/2841] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:16 2022] PUT /identity/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0/users/a45ad433effb4583b4c8bf8cbc8d6eb9/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:37:16.150675 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.151330 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.151456 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.178554 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] MFA Rules not processed for user `a45ad433effb4583b4c8bf8cbc8d6eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:16.179747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:16.246794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1418/2842] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:16.258383 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:16.260093 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:16.316969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030c69d-1cab-4705-9ee8-40022167cd2f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:16.320587 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:16.321222 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.321501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.321773 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.330622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:16.332042 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8957d9-8713-4168-9386-bfc207574efe service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:16.341264 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1425/2843] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:16.726381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:16.761096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:16.789221 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af386-a7ab-4874-a4c9-d835a0262fc2 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:16.793748 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:16.794663 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.794951 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.795227 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] PATH_INFO: `/v3/users/0621b159df9b4e3fa8b4ddd46e1bfabd` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.796412 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0621b159df9b4e3fa8b4ddd46e1bfabd)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:16.799133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:16.844111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0621b159df9b4e3fa8b4ddd46e1bfabd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:16.845186 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0621b159df9b4e3fa8b4ddd46e1bfabd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:16.845788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0621b159df9b4e3fa8b4ddd46e1bfabd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:16.857309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0621b159df9b4e3fa8b4ddd46e1bfabd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:16.864854 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0621b159df9b4e3fa8b4ddd46e1bfabd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:16.877154 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1419/2844] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:16 2022] DELETE /identity/v3/users/0621b159df9b4e3fa8b4ddd46e1bfabd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:16.881668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:16.881986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:16.882262 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:16.900595 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:16.901759 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:16.943489 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:16.959607 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1426/2845] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:16.969153 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:16.971170 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:17.028207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e335d-6bbc-4625-8459-26b7c3060dcf admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:17.032945 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:17.033612 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:17.033920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:17.034211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:17.043720 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:17.045148 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:17.055171 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1420/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:17.323180 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:17.324647 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:17.336801 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059574c1-5368-4a5c-8d43-2fac4e091768 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:17.341481 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:17.342379 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:17.342687 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:17.342966 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] PATH_INFO: `/v3/projects/5cdcb419b57f4b72aa5be26aeb22cfed` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:17.344711 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdcb419b57f4b72aa5be26aeb22cfed)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:17.347184 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:17.393091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdcb419b57f4b72aa5be26aeb22cfed', 'request_id': 'req-fe2138de-db8a-4924-99e9-034bc57d0d0a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.398592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdcb419b57f4b72aa5be26aeb22cfed', 'request_id': 'req-fe2138de-db8a-4924-99e9-034bc57d0d0a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.404663 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdcb419b57f4b72aa5be26aeb22cfed', 'request_id': 'req-fe2138de-db8a-4924-99e9-034bc57d0d0a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.416940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] The token cache is being invalidate because project 5cdcb419b57f4b72aa5be26aeb22cfed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:17.417230 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.417856 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.419416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1427/2847] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:17 2022] DELETE /identity/v3/projects/5cdcb419b57f4b72aa5be26aeb22cfed => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:17.423367 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:17.433474 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f481812-0868-4bbc-a974-04531c0b85f2 service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:17.482256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:17.490976 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:17.491930 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:17.492269 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:17.492718 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] PATH_INFO: `/v3/users/a45ad433effb4583b4c8bf8cbc8d6eb9` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:17.494255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45ad433effb4583b4c8bf8cbc8d6eb9)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:17.496233 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:17.541044 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45ad433effb4583b4c8bf8cbc8d6eb9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.541686 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45ad433effb4583b4c8bf8cbc8d6eb9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.542318 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45ad433effb4583b4c8bf8cbc8d6eb9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.553888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45ad433effb4583b4c8bf8cbc8d6eb9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.560729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-af5f02fb-85d0-403e-9e7a-b36f4731a362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45ad433effb4583b4c8bf8cbc8d6eb9'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.573342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1421/2848] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:17 2022] DELETE /identity/v3/users/a45ad433effb4583b4c8bf8cbc8d6eb9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:17.839434 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:17.840942 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:17.858150 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2138de-db8a-4924-99e9-034bc57d0d0a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:17.915208 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:17.916065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:17.916340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:17.916609 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] PATH_INFO: `/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:17.917826 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e485b5feaa54fa0bc07f2e12222d9b0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:17.919696 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:17.964018 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e485b5feaa54fa0bc07f2e12222d9b0', 'request_id': 'req-c43da766-fd51-418a-b291-29b7d0f4d00d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.969295 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e485b5feaa54fa0bc07f2e12222d9b0', 'request_id': 'req-c43da766-fd51-418a-b291-29b7d0f4d00d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.975738 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e485b5feaa54fa0bc07f2e12222d9b0', 'request_id': 'req-c43da766-fd51-418a-b291-29b7d0f4d00d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.987940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] The token cache is being invalidate because project 5e485b5feaa54fa0bc07f2e12222d9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:17.988226 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.988834 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-c43da766-fd51-418a-b291-29b7d0f4d00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:17.990425 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1428/2849] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:17 2022] DELETE /identity/v3/projects/5e485b5feaa54fa0bc07f2e12222d9b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:17.995266 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:17.995561 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:17.995892 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.014713 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:18.015954 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:18.076471 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1422/2850] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:37:18.084786 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.085076 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.085354 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.091915 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:18.106420 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:18.107644 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:18.116169 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1429/2851] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:18.120493 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.130876 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442a25d-27e9-493a-9ea2-b9586a70d554 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.135484 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.136133 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.136417 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.136692 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.137410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:18.137716 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.139338 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.151996 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1423/2852] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:37:18.156285 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.165428 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f09a-d906-4119-8f38-df7a41305c84 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.170170 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.170755 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.171035 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.171308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.171999 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.173879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.199699 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1430/2853] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:18.203693 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.214104 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f14695-0c9a-43fb-887e-80c303169b0a admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.268896 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.269548 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.269831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.270205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.270878 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.272763 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.280085 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:18.294526 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1424/2854] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:18.298590 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.308841 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3a0b3-6085-45b8-af67-110d6f6e44f0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.313514 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.314207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.314487 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.315274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.315993 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.317583 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.327855 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1431/2855] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:18.332414 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.342214 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293815e-0bfa-4725-90f3-f027b46efab6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.346868 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.347508 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.347789 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.348059 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.348768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.350374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44829f66-c370-4533-a948-355fd3e00e99 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.360036 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1425/2856] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:18.364351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.373892 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e62884-760f-4b63-9eda-269d267e5feb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.379062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.379940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.380219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.380474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] PATH_INFO: `/v3/projects/22b614393ec545e2bc8672553b161e7b/users/358881748e65481eabd50e11da3c7e19/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.394584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b614393ec545e2bc8672553b161e7b, user_id=358881748e65481eabd50e11da3c7e19, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.397188 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.417650 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1432/2857] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:18 2022] PUT /identity/v3/projects/22b614393ec545e2bc8672553b161e7b/users/358881748e65481eabd50e11da3c7e19/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:18.429241 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.429710 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.429819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.457001 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] MFA Rules not processed for user `358881748e65481eabd50e11da3c7e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:18.458255 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:18.521835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1426/2858] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:18.526344 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.586984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ebff7-1532-4cd7-88e5-b5694e58ed50 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.591659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.592316 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.592599 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.592876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.593576 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.595517 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.620096 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1433/2859] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:18.624028 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.635427 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce8df-a4b5-48a0-ac8a-2f5bd276640d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.691455 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.692058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.692339 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.692609 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.693305 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.695254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.714388 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1427/2860] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:18.718364 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.728995 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a05-1d9c-4cbf-8882-066c0d5711d6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.733550 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.734235 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.734518 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.734794 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.735538 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.738053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.748557 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1434/2861] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:18.752751 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.765172 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592391c-07ae-425e-b701-a13ac9753ffe admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.769883 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.770797 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.771081 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.771362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] PATH_INFO: `/v3/projects/8e3527c06a714641a58c0da1b2f37261/users/696f1a60df7f4ff1bfac50e2ae973d2e/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.786627 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3527c06a714641a58c0da1b2f37261, user_id=696f1a60df7f4ff1bfac50e2ae973d2e, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.789304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.802580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1428/2862] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:18 2022] PUT /identity/v3/projects/8e3527c06a714641a58c0da1b2f37261/users/696f1a60df7f4ff1bfac50e2ae973d2e/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:18.806509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.816404 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4d5e5-78dd-4435-8d53-9bca1c5533d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.870797 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.871449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.871732 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.872007 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.872725 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.874340 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ea823-680b-4cd6-b7c9-f12e71048200 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.883814 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1435/2863] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:18.887835 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:18.898209 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e284e-df2d-4d53-87a4-c4a2c2485af5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:18.902953 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:18.903819 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.904096 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.904363 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] PATH_INFO: `/v3/projects/8e3527c06a714641a58c0da1b2f37261/users/696f1a60df7f4ff1bfac50e2ae973d2e/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:18.906362 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3527c06a714641a58c0da1b2f37261, user_id=696f1a60df7f4ff1bfac50e2ae973d2e, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:18.909518 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:18.919906 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1429/2864] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:18 2022] PUT /identity/v3/projects/8e3527c06a714641a58c0da1b2f37261/users/696f1a60df7f4ff1bfac50e2ae973d2e/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:37:18.982281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:18.982571 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:18.982849 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:19.001986 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:19.011602 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] MFA Rules not processed for user `696f1a60df7f4ff1bfac50e2ae973d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:19.012825 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:19.081114 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1436/2865] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:19.092599 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:19.094370 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:19.120880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:19.154482 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65c015-e459-4b4c-a4b0-9fd12d9a54ea admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:19.158122 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:19.158768 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:19.159046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:19.159316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:19.168232 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:19.169655 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:19.179540 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1430/2866] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:19.250164 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:19.260398 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a9fc6-aa3a-4785-96af-11a5391047d5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:19.264021 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:19.264659 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:19.264962 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:19.265242 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:19.322279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:19.323720 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1ad1-72e3-4cbe-84e9-be26a824fe1a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:19.332584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1437/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:22.004190 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:22.066374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1d1a-033a-4a54-9976-3046305e2cce service cinder] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:22.070880 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:22.071747 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:22.072024 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:22.072297 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] PATH_INFO: `/v3/users/358881748e65481eabd50e11da3c7e19` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:22.073464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358881748e65481eabd50e11da3c7e19)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:22.075437 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:22.121546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358881748e65481eabd50e11da3c7e19'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.122215 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358881748e65481eabd50e11da3c7e19'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.122821 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358881748e65481eabd50e11da3c7e19'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.135168 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358881748e65481eabd50e11da3c7e19'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.142140 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358881748e65481eabd50e11da3c7e19'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.155568 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1431/2868] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:22 2022] DELETE /identity/v3/users/358881748e65481eabd50e11da3c7e19 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 15:37:22.160386 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:22.160851 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:22.160948 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:22.178601 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:22.179770 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:22.235787 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1438/2869] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:22.246045 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:22.247432 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:22.293795 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:22.306591 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc90a3-8a35-4c20-9a89-65e2d28cb7f6 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:22.310373 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:22.311030 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:22.311316 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:22.311596 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:22.321435 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:22.322901 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:22.332403 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1432/2870] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:22.593335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:22.594775 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:22.607240 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f454-9955-48fe-a20d-7edb97c88a62 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:22.612688 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:22.613564 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:22.613843 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:22.614151 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] PATH_INFO: `/v3/projects/22b614393ec545e2bc8672553b161e7b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:22.615347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b614393ec545e2bc8672553b161e7b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:22.617274 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:22.647931 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:22.663969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b614393ec545e2bc8672553b161e7b', 'request_id': 'req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.669470 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b614393ec545e2bc8672553b161e7b', 'request_id': 'req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.676791 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b614393ec545e2bc8672553b161e7b', 'request_id': 'req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.690332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] The token cache is being invalidate because project 22b614393ec545e2bc8672553b161e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:22.690735 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.691376 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.692956 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1439/2871] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:22 2022] DELETE /identity/v3/projects/22b614393ec545e2bc8672553b161e7b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:22.697055 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:22.707815 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1ef00-d81c-4893-af8a-10e84f5db94e service neutron] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:22.764146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:22.765020 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:22.765309 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:22.765587 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] PATH_INFO: `/v3/users/696f1a60df7f4ff1bfac50e2ae973d2e` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:22.766794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] RBAC: Authorizing `identity:delete_user(user_id=696f1a60df7f4ff1bfac50e2ae973d2e)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:22.768757 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:22.813578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696f1a60df7f4ff1bfac50e2ae973d2e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.814264 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696f1a60df7f4ff1bfac50e2ae973d2e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.814899 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696f1a60df7f4ff1bfac50e2ae973d2e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.826790 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696f1a60df7f4ff1bfac50e2ae973d2e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.834205 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fa23e7a2-a6ce-4408-910b-be9dd2bd998d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696f1a60df7f4ff1bfac50e2ae973d2e'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:22.847068 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1433/2872] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:22 2022] DELETE /identity/v3/users/696f1a60df7f4ff1bfac50e2ae973d2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:23.115197 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.116684 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:23.129561 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1b67c-45eb-4216-a7eb-1a0c2b6ca67b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.186760 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.187617 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.187900 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.188174 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] PATH_INFO: `/v3/projects/8e3527c06a714641a58c0da1b2f37261` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.189347 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3527c06a714641a58c0da1b2f37261)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.191315 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.236631 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3527c06a714641a58c0da1b2f37261', 'request_id': 'req-a80a6f8d-d34a-4011-9785-fa338b0464a5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:23.242332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3527c06a714641a58c0da1b2f37261', 'request_id': 'req-a80a6f8d-d34a-4011-9785-fa338b0464a5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:23.248292 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3527c06a714641a58c0da1b2f37261', 'request_id': 'req-a80a6f8d-d34a-4011-9785-fa338b0464a5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:23.260591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] The token cache is being invalidate because project 8e3527c06a714641a58c0da1b2f37261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:23.260881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:23.261501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a80a6f8d-d34a-4011-9785-fa338b0464a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:23.263145 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1440/2873] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:23 2022] DELETE /identity/v3/projects/8e3527c06a714641a58c0da1b2f37261 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:23.268131 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.269159 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.269283 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.287445 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:23.288648 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:23.348670 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1434/2874] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:37:23.356269 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.356559 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.356836 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.374949 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:23.376129 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:23.384510 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1441/2875] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:23.388480 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.398696 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad659f4-545c-4876-b2e9-d691b9567e63 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.403207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.403852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.404135 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.404409 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.405130 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80194) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:23.405464 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.407083 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.408535 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:23.420801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1435/2876] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 15:37:23.424911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.434205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d97cf8-3bb1-4b8b-a2a2-3ca610eed7e2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.438846 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.439488 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.439776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.440053 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.441298 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.443216 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.468608 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1442/2877] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:23.472056 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.483079 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2bb-3bd5-4f56-9965-a9389c5a80f8 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.539097 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.539672 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.539963 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.540237 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.540920 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.542852 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.561802 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1436/2878] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:23.566506 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.576575 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8892a-8643-4ae6-b29b-2a62ea544cb6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.581730 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.582400 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.582682 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.582959 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.583676 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.585288 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.595907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1443/2879] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:23.599841 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.609803 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796a1e5-343a-46e0-8bb0-ac5be119ccba admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.615319 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.615966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.616317 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.616595 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.617311 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.618947 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a327e9-c248-41d7-a71c-3341578e36d2 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.629348 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1437/2880] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:23.633219 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.642911 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a993-0300-419a-b74b-a991a0a14a5a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.647501 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.648363 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.648640 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.648907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] PATH_INFO: `/v3/projects/8f9dfbe2706642c69e694ccc8392dee0/users/e08b5b3b9f6f40d4995a41ba69bdff5f/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.651110 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:23.666091 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9dfbe2706642c69e694ccc8392dee0, user_id=e08b5b3b9f6f40d4995a41ba69bdff5f, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.668776 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.681940 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1444/2881] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:23 2022] PUT /identity/v3/projects/8f9dfbe2706642c69e694ccc8392dee0/users/e08b5b3b9f6f40d4995a41ba69bdff5f/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:23.692982 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.693287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.693614 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.719666 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] MFA Rules not processed for user `e08b5b3b9f6f40d4995a41ba69bdff5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:23.720846 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:23.783569 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1438/2882] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:23.787914 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.848927 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b289e-d1f2-49f1-b310-fe9ad72281a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.853519 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.854193 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.854473 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.854744 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.855416 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.857308 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.881421 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1445/2883] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:23.885512 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.896942 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872f7b-1cbc-443c-8de0-4515c7b9752d None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.951374 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.952035 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.952314 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.952585 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] PATH_INFO: `/v3/users` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.953260 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.955195 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:23.962958 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:23.976111 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1439/2884] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:23 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 15:37:23.980118 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:23.990613 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef67ee0-5865-4a03-92cb-fc496271ff20 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:23.995413 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:23.996062 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:23.996341 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:23.996612 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:23.997337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:23.998969 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:24.011781 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1446/2885] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:24.015861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:24.026509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3ca82-998d-4a8c-814d-f0b47211b541 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:24.031086 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:24.031967 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:24.032301 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:24.032580 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] PATH_INFO: `/v3/projects/6beca548464f45258fbc279ab687efe4/users/cb3683f460a34fd2b20b7b820063bc95/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:24.048490 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beca548464f45258fbc279ab687efe4, user_id=cb3683f460a34fd2b20b7b820063bc95, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:24.051211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:24.063827 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1440/2886] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:24 2022] PUT /identity/v3/projects/6beca548464f45258fbc279ab687efe4/users/cb3683f460a34fd2b20b7b820063bc95/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:24.068254 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:24.078146 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a160-0917-4406-bace-41effbd0eda8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:24.133785 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:24.134397 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:24.134675 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:24.134946 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:24.135657 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:24.137237 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56a6cb-ff05-4a00-bb4b-f5611f24c524 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:24.147305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1447/2887] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:24.151743 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:24.162254 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0d30-d9ab-46f9-9732-1ac885bc9d7f admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:24.166842 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:24.167744 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:24.168025 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:24.168295 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] PATH_INFO: `/v3/projects/6beca548464f45258fbc279ab687efe4/users/cb3683f460a34fd2b20b7b820063bc95/roles/ad052cc0d669492da50cd35179f4ce54` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:24.170287 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beca548464f45258fbc279ab687efe4, user_id=cb3683f460a34fd2b20b7b820063bc95, role_id=ad052cc0d669492da50cd35179f4ce54)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:24.172877 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:24.183004 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1441/2888] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:24 2022] PUT /identity/v3/projects/6beca548464f45258fbc279ab687efe4/users/cb3683f460a34fd2b20b7b820063bc95/roles/ad052cc0d669492da50cd35179f4ce54 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:24.194668 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:24.195148 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:24.195270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:24.221077 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] MFA Rules not processed for user `cb3683f460a34fd2b20b7b820063bc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:24.222342 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:24.262065 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:24.289191 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1448/2889] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 15:37:24.299794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:24.301602 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:24.358509 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a88a9-c613-43b2-9969-4e720d1f184b admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:24.362871 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:24.363504 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:24.363780 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:24.364053 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:24.420341 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:24.421702 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333f856-0cfe-4dc3-81d6-7afdeeb7b0ec service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:24.430560 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1442/2890] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:26.927221 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:26.988305 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad325-b372-4fec-84d9-aa1d2d6312c5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:26.992810 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:26.993673 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:26.993984 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:26.994281 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] PATH_INFO: `/v3/users/e08b5b3b9f6f40d4995a41ba69bdff5f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:26.995464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08b5b3b9f6f40d4995a41ba69bdff5f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:26.997390 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:27.043189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08b5b3b9f6f40d4995a41ba69bdff5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.043840 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08b5b3b9f6f40d4995a41ba69bdff5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.044449 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08b5b3b9f6f40d4995a41ba69bdff5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.052095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08b5b3b9f6f40d4995a41ba69bdff5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.059717 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08b5b3b9f6f40d4995a41ba69bdff5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.076881 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1449/2891] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:26 2022] DELETE /identity/v3/users/e08b5b3b9f6f40d4995a41ba69bdff5f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:27.081328 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb357f-8580-4510-8618-ef4743521080 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:27.081847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb357f-8580-4510-8618-ef4743521080 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:27.082014 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb357f-8580-4510-8618-ef4743521080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:27.100335 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-0deb357f-8580-4510-8618-ef4743521080 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:27.101704 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0deb357f-8580-4510-8618-ef4743521080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:27.167058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1443/2892] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:27.177162 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:27.178584 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:27.234498 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286af2f-9891-4e6d-93f4-7a61ea3db897 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:27.239072 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:27.239715 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:27.240000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:27.240270 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:27.249241 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:27.250703 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:27.255619 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:27.260573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1450/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:27.762433 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb357f-8580-4510-8618-ef4743521080 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:27.763847 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-0deb357f-8580-4510-8618-ef4743521080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:27.775729 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb357f-8580-4510-8618-ef4743521080 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:27.780623 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:27.781859 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:27.782794 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:27.783251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] PATH_INFO: `/v3/projects/8f9dfbe2706642c69e694ccc8392dee0` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:27.785143 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9dfbe2706642c69e694ccc8392dee0)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:27.787117 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:27.789664 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:27.834853 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9dfbe2706642c69e694ccc8392dee0', 'request_id': 'req-fc5f01bd-79ee-4936-b651-02b8a2d492c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.840469 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9dfbe2706642c69e694ccc8392dee0', 'request_id': 'req-fc5f01bd-79ee-4936-b651-02b8a2d492c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.848046 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9dfbe2706642c69e694ccc8392dee0', 'request_id': 'req-fc5f01bd-79ee-4936-b651-02b8a2d492c0'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.859060 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] The token cache is being invalidate because project 8f9dfbe2706642c69e694ccc8392dee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:27.859345 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.859966 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.861488 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1444/2894] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:27 2022] DELETE /identity/v3/projects/8f9dfbe2706642c69e694ccc8392dee0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:27.866251 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:27.875907 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031be6-9690-4875-bc16-2bee15477cc0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:27.931326 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:27.932116 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:27.932422 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:27.932694 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] PATH_INFO: `/v3/users/cb3683f460a34fd2b20b7b820063bc95` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:27.933888 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3683f460a34fd2b20b7b820063bc95)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:27.935804 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:27.980001 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3683f460a34fd2b20b7b820063bc95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.980642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3683f460a34fd2b20b7b820063bc95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.981243 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3683f460a34fd2b20b7b820063bc95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.989075 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3683f460a34fd2b20b7b820063bc95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:27.996311 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f304b20c-0a08-4330-bed5-e6d493ca6f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3683f460a34fd2b20b7b820063bc95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.013013 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1451/2895] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:27 2022] DELETE /identity/v3/users/cb3683f460a34fd2b20b7b820063bc95 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:28.282801 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.285007 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:28.303270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f01bd-79ee-4936-b651-02b8a2d492c0 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.360608 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.361475 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.362065 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.362342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] PATH_INFO: `/v3/projects/6beca548464f45258fbc279ab687efe4` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.363515 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6beca548464f45258fbc279ab687efe4)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.365419 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.417106 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6beca548464f45258fbc279ab687efe4', 'request_id': 'req-c90852e1-b17a-49bd-ae3d-d580eb4100ef'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.422634 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6beca548464f45258fbc279ab687efe4', 'request_id': 'req-c90852e1-b17a-49bd-ae3d-d580eb4100ef'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.431110 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6beca548464f45258fbc279ab687efe4', 'request_id': 'req-c90852e1-b17a-49bd-ae3d-d580eb4100ef'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.442381 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] The token cache is being invalidate because project 6beca548464f45258fbc279ab687efe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:28.442667 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.443352 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-c90852e1-b17a-49bd-ae3d-d580eb4100ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:28.444825 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1445/2896] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:28 2022] DELETE /identity/v3/projects/6beca548464f45258fbc279ab687efe4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:28.450432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.450724 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.451000 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.469282 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:28.470509 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:28.529954 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1452/2897] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:28.537617 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.537928 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.538211 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.555961 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:28.557146 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:28.564898 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1446/2898] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:28.569394 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.578876 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101947c-1569-4e50-9f9d-7f995432224f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.584058 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.584705 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.584982 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.585253 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.586015 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 15:37:28.586320 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.587899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.599570 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1453/2899] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 15:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 15:37:28.603500 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.612817 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19b8c-abfe-436b-ba39-88192c990705 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.617399 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.618082 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.618361 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.618631 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.619304 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.621217 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.634387 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:28.648141 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1447/2900] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 15:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:28.651883 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.661879 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7bce-5b90-4ba2-9057-49a2fd84cd22 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.665464 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:28.720351 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.721008 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.721286 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.721558 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.722279 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.724196 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.743234 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1454/2901] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 15:37:28 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 15:37:28.747267 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.757792 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3f9b-8226-4a4e-8838-4980023cb1b5 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.762342 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.762989 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.763270 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.763544 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.764256 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.765829 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.776653 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1448/2902] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:28.780478 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.790360 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cfb43-f8f2-4b61-a813-66f3baa9e8b6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.794974 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.795627 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.795910 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.796182 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.796899 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.798920 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933887-1561-49d8-98a9-70be3ab308f8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.808758 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1455/2903] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 15:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 15:37:28.812610 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.822887 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd4e9-ec5c-45d8-a2fb-3e89f7df1485 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:28.827389 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:28.828251 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.828530 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.828799 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] PATH_INFO: `/v3/projects/23af52de33ea4350bbb4b53758dc7b0f/users/18f3274cdaa44f1199ff7a1139d0e1a6/roles/b2d7b12184614f5997f9ce444f519150` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.843654 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af52de33ea4350bbb4b53758dc7b0f, user_id=18f3274cdaa44f1199ff7a1139d0e1a6, role_id=b2d7b12184614f5997f9ce444f519150)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:28.846324 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:28.858788 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1449/2904] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 15:37:28 2022] PUT /identity/v3/projects/23af52de33ea4350bbb4b53758dc7b0f/users/18f3274cdaa44f1199ff7a1139d0e1a6/roles/b2d7b12184614f5997f9ce444f519150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:28.869710 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:28.870103 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:28.870471 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:28.897625 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] MFA Rules not processed for user `18f3274cdaa44f1199ff7a1139d0e1a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:28.899205 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:28.961002 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1456/2905] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:28.972296 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:28.973888 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:29.030546 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332cf89-1c90-40bb-b561-663162001049 admin admin] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:29.034210 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ca62c1d2e458d9831415740222bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:29.034856 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] REQUEST_METHOD: `GET` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:29.035136 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:29.035410 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:29.043635 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:29.045058 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcce8c5-acc0-4991-8449-f4de72410206 service cinder] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:29.054375 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1450/2906] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:31.570117 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:31.631227 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fdbf6-83e0-43d1-8422-43b3d46a2f07 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:31.635754 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:31.636622 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:31.636904 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:31.637177 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] PATH_INFO: `/v3/users/18f3274cdaa44f1199ff7a1139d0e1a6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:31.638375 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f3274cdaa44f1199ff7a1139d0e1a6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:31.640332 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:31.656474 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:31.685880 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f3274cdaa44f1199ff7a1139d0e1a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:31.686544 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f3274cdaa44f1199ff7a1139d0e1a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:31.687140 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f3274cdaa44f1199ff7a1139d0e1a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:31.694334 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f3274cdaa44f1199ff7a1139d0e1a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:31.701803 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f3274cdaa44f1199ff7a1139d0e1a6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:31.719367 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1457/2907] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 15:37:31 2022] DELETE /identity/v3/users/18f3274cdaa44f1199ff7a1139d0e1a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:31.723826 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] REQUEST_METHOD: `POST` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:31.724315 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:31.724444 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:31.742682 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.auth.core [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] MFA Rules not processed for user `752e00b3ffc94b3ca8223ee74bcd4983`. Rule list: `[]` (Enabled: `True`). {{(pid=80194) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 15:37:31.743882 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:31.922207 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1451/2908] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 15:37:31.932187 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:31.933591 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:31.989186 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc78bf-687b-450a-8db2-1e2190070346 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:31.992779 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ffb1028c44466a4192e0c17bb7df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:31.993409 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:31.993686 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:31.993983 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:32.002913 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:32.004352 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:32.014433 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1458/2909] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:37:32.274332 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] Authenticating user token {{(pid=80194) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:37:32.275831 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.fernet_utils [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80194) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:37:32.288257 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc86bd-e007-4e83-aabf-a62291e5e876 None None] Validating token access rules against request {{(pid=80194) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:37:32.292824 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752e00b3ffc94b3ca8223ee74bcd4983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '384fdc49fff9422ba6ec721becb44e7d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80194) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:37:32.293687 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:37:32.294003 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:37:32.294280 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] PATH_INFO: `/v3/projects/23af52de33ea4350bbb4b53758dc7b0f` {{(pid=80194) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:37:32.295466 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23af52de33ea4350bbb4b53758dc7b0f)` {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:37:32.297353 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] RBAC: Authorization granted {{(pid=80194) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:37:32.345539 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23af52de33ea4350bbb4b53758dc7b0f', 'request_id': 'req-e7dd055c-9865-455f-9364-970900fb86fd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:32.350594 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:32.351837 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23af52de33ea4350bbb4b53758dc7b0f', 'request_id': 'req-e7dd055c-9865-455f-9364-970900fb86fd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:32.359866 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23af52de33ea4350bbb4b53758dc7b0f', 'request_id': 'req-e7dd055c-9865-455f-9364-970900fb86fd'} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:32.372578 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] The token cache is being invalidate because project 23af52de33ea4350bbb4b53758dc7b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80194) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 15:37:32.372861 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:32.373481 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG keystone.notifications [None req-e7dd055c-9865-455f-9364-970900fb86fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80194) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 15:37:32.375057 dv-cinder-848848-4-smb devstack@keystone.service[80194]: [pid: 80194|app: 0|req: 1452/2910] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 15:37:32 2022] DELETE /identity/v3/projects/23af52de33ea4350bbb4b53758dc7b0f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 15:37:42.010189 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:37:42.369649 dv-cinder-848848-4-smb devstack@keystone.service[80194]: DEBUG dbcounter [-] [80194] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 15:39:51.828207 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 15:39:51.829592 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:39:51.963662 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5fd1-dd1e-4f2e-accd-72be6be18073 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 15:39:52.021337 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e61587f7080b4cbcb3e906efaf4cb894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8d976e6635e44dd9faaeeeb1631558f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 15:39:52.022048 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 15:39:52.022335 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 15:39:52.022642 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 15:39:52.024432 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 15:39:52.035491 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 15:39:52.037095 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9950d-4c10-4e5a-a90b-c8ee775b2bb2 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 15:39:52.047573 dv-cinder-848848-4-smb devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1459/2911] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 15:40:02.043287 dv-cinder-848848-4-smb devstack@keystone.service[80193]: DEBUG dbcounter [-] [80193] Writing DB stats keystone:SELECT=89 {{(pid=80193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}